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ABSTRACT 


This  study  svaluatea  aymbola  and  formats  for  the  F/A-18 
Hornet  hsad-up  display  (HUD)  and  Attltuds  Dlractlonal 
Indicator  (ADI)  for  uaa  by  pilots  in  racovtrlng  from 
unusual  aircraft  attitudas.  .  Two  aurvays  wars  eonductad  to 
collact  pilot  opinions  on  various  symbols  and  formats > 
basad  on  past  axparimantal  rasaarch  and  currant 
raeommandationa.  For  tha  first  aurvay»  60  F/A-18  pilots 
prioritlzad  savaral  typas  of  HUD  symbols  according  to  tha 
amount  of  Information  thasa  aymbols  provlda  for  tha  pilot 
whlla  ha  la  in  an  unusual  attltuds.  In  soma  casas,  tha 
pilots  also  wars  aa)cad  to  choosa  thair  prafarrad  symbols. 
Tha  sacond  survay  sas  basad  on  tha  rasults  of  tha  first  and 
vas  adninlstarad  to  56  F/A’-18  pilots.  Thasa  pilots 
salactad  thair  prafarrad  HUD  or  ADI  display  formats, 
choosing  one  from  two  to  flva  possibilltias  in  aach  casa. 
Tha  spaoiflc  symbols  and  formats  that  nara  avaluatad  ara 
dascrlbad  in  datall.  Survay  rasults  ara  providad*  and 
raeommandationa  ara  mada  for  display  Implamentatlon  and  for 
furthar  rasaarch  and  tasting  of  symbols  and  formats. 
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I .  INTRODUCTION 


A.  BACKGROUND 

*  Th«  Navy's  F/A->18  Hornat  aircraft  rapraaanta  a  major 

stap  in  tha  application  of  intagratad  controls  and 

( 

coinputar<*controllad  displays  toward  tha  reduction  of  pilot 
workload  and  anhancamant  of  mission  succass  (Figure  1) . 
Tha  Hornat  craw  station  was  designed  to  provide  tha 
capabilities  of  both  tha  F-4  and  A-7  aircraft.  It  is 
expected  to  perform  both  the  fighter  and  attack  roles  in 
battle,  and  to  be  operable  by  one  pilot.  Mission 

reliability  is  increased  by  a  combination  of  improved 
hardware  reliability  and  functional  redundancy.  [Rtf.  l:p. 

4 

82] 

.  The  head-*up  display  (HUD)  is  the  F/A  18  primary  flight 

instrument  for  weapon  delivery  and  navigation,  including 
manual  and  automatic  carrier  landing  modes  (Figure  2) .  The 
HUD  is  a  display  which  projects  collimated  symbol  imagery 
onto  a  glass  surface  in  the  pilot's  forward  field  of  view. 
The  technique  results  in  the  head-np  presentation  of  flight 
control  Information,  possibly  combined  with  weapon  delivery 
cues.  Yet  it  does  not  interfere  with  external  visual  cues 
from  the  scene  normally  viewed  through  the  windshield. 

a 

Attitude  information,  alphanumeric  cues,  and  steering 

•  commands  are  projected  on  the  HUD  combiner.  Pitch  and  roll 
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Flour*  2.  F/A-18  Hsad-Up  Dlaplay 
[R*f.  2ip.  8] 

Information  la  ahown  by  a  flight  path  laddar  (alao  callad  a 
pitch  laddar)  and  a  bank  acala.  Airapaod  and  altituda  ara 
praaantad  in  a  digital  format.  Haading  ia  datarminad  by  ua* 
of  a  moving  tap*  eompaaa  raadout  along  th*  top  of  th* 
display.  optica  ara  focusad  at  infinity  for  aaay 
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assimilation  by  the  pilot  while  scanning  the  area  outside 
the  crew  station. [Ref .  2:p.  3] 

Rapid  recognition  of  aircraft  spatial  orientation  Is 
essential  for  the  pilot  when  recovering  from  unusual, 
unexpected  attitudes  during  aerobatic  and  emergency 
maneuvers.  Under  these  circumstances,  recovery  of  the 
desired  attitude  using  aircraft  Instruments  Is  strongly 
affected  by  display  design  factors.  During  any  loss  of 
situational  awareness  by  the  pilot,  the  HUD  may  not  provide 
sufficient  spatial  orientation  cues  for  quick  recovery. 
[Ref.  3:p.  14-1] 

Situational  awareness  encompases  awareness  of  both  the 
"big"  (tactical)  picture  and  also  the  "small"  (spatial 
orientation)  picture.  Spatial  orientation  refers  to  the 
aircrew's  awareness  of: 

1.  Xlrcraft  attitude:  pitch  angle,  pitch  rate,  bank 
angle,  bank  angle  rate. 

2.  Aircraft  energy  state,  airspeed,  acceleration. 

3.  Proximity  over  terrain. [Ref .  4:p.  3] 

Spatial  orientation  Is  gained  through  cockpit  displays, 
outside-the-cockplt  visual  cues,  aural  cues,  and  tactile 
cues.  It  may  be  lost  through  distraction,  disorientation, 
mlsorlentatlon,  and  g-lnducsd  loss  of  conciousness . 
Disorientation  occurs  when  conflicting  sensory  Inputs  are 
perceived  and  conflicts  are  not  resolved.  The  common 
example  of  this  la  vertigo  caused  by  visual  Illusions 
during  instrument  flight.  Mlsorlentatlon  occurs  when 
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incorrect  seniory  Inputs  are  perceived  and  treated  as 
correct.  A  common  example  of  this  Is  the  pilot  who 
unknowingly  flies  off  a  frozen  or  badly  processed  gyro. 
[Ref.  4:p.  3] 

Since  1979,  14  F/A-18a  have  been  lost  in  mishaps  where 
loss  of  situational  awareness,  spatial  disorientation,  or 
unexplained  flight  into  the  surface  are  listed  as  confirmed 
or  probable  cause  factors.  This  number  represents  57%  of 
all  U.S.  Navy  and  Marine  Corps  losses  to  date,  plus,  50%  of 
all  Canadian  and  100%  of  Royal  Australian  Air  Force  F/A-18 
losses.  [Ref.  4:p.  2] 

Evidence  points  to  Inadequate  or  ambiguous  attitude 
displays  in  the  cockpit  as  a  probable  cause  of  situational 
awareness  loss.  A  potential  problem  that  has  bean 
identified  is  an  inability  of  the  pilot  to  recognize  when 
he  is  in  an  unusual  attitude  and  then  recover  while  using 
the  HUD  and  associated  cockpit  displays. [Ref .  4:p.  5] 

B.  HUD  SYMBOLOGIES  AND  FORMATS 

Of  special  concern  for  this  study  are  HUD  symbols  and 
formats  that  may  assist  pilots  in  recovery  from  unusual 
attitudes.  Some  of  tae  symbologies  addressed  here  are 
currently  in  use  on  HUDs  in  operational  Navy  aircraft. 
Others  have  been  proposed  for  use  by  various  researchers 
who  also  have  proposed  modif Icatlone  to  the  attitude 
direction  indicator  (ADI) .  Figures  3  to  8  Illustrate 
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various  HUD  and  XDI  aymbols  and  formats  that  are  of 
interest.  These  are  described  below. 

1.  Pitch  Reference  frame 

The  position  and  format  of  the  pitch  scale  or 
ladder  are  cues  that  may  provide  information  to  the  pilot 
when  he  is  in  an  unusual  attitude.  The  pitch  reference 
frame  consists  of  the  ladder  plus  other  symbols, 
representing  fixed  angles  in  space.  These  symbols  are  used 
as  references  for  aircraft  pitch  and  velocity  vector 
symbols  (see  Figure  2).  They  include 

a.  Horiion  line:  a  horizontal  line  which 
represents  zero  pitch  (the  local  horizontal)  or  the 
location  of  the  real  world  horizon. 

b.  Pitch  ladder  (also  called  flight  path  ladder) : 
a  set  of  roughly  perallel  lines  rspresenting  angular 
distances  above  and  below  the  horizon,  usually  in  S-dagrae 
increments. 

e.  Pitch  ladder  tails:  short  vertical  lines  that 
can  be  present  on  the  ends  of  the  above-horizon  and  below- 
horizon  pitch  ladders  indicating  the  direction  toward  the 
horizon. 

d.  Pitch  ladder  degree  numerals:  Numbers  adjacent 
to  the  ladder  tails  representing  angular  distance  above  and 
below  the  horizon,  in  degrees.  [Ref.  5:p.  4] 


6 


2.  Flxtd  Aircraft  Rafararca 

Tha  fixed  aircraft  reference  symbol  (sometimes 
called  Theta  or  a  xaterllne  symbol)  represents  an  extension 
ahead  of  tha  aircraft  of  tha  fusalage  raferanca  line  or 
othar  longitudinal  aircraft  rafarenca  lina  (see  Figure  3). 
The  symbol  usually  is  shaped  li)ce  a  "W".  It  indicates 
relative  pitch  and  roll  ‘  angles  of  tha  aircraft  when 
compared  to  tha  horizon  (either  artificial  or  real  world) 
or  to  a  displayed  pitch  ladder.  [Ref.  5:p.  4] 


Figure  3.  HUD  With  Waterline  Symbol 
[Ref.  6:p.l5] 


3.  Velocity  Vector 

The  velocity  vector  (sometimes  referred  to  as  Gamma 
or  the  flight  path  marlter)  is  a  symbol  indicating  tha 
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linear  projection  of  a  vector  representing  the  aircraft 
velocity  (see  Figure  4) .  It  usually  resembles  an  aircraft, 
as  seen  tall-on.  The  vector  originates  at  the  aircraft 
center-of-gravlty  or  some  other  well-defined  location  on 
the  aircraft.  A  location  forward  of  the  aircraft  center- 
of-gravity  is  sometimes  used  as  origin  to  provide  pitch 
rate  quickening  of  the  velocity  vector  symbol,  [kef.  5:p. 
4] 

4.  Air  Maas  Velocity  Vector 

The  air  velocity  vector  is  a  symbol  that  represents 
the  linear  projection  of  a  vector  indicating  aircraft 
velocity  through  the  air  mass  (see  Figure  S) .  It  resembles 
the  lower  half  of  the  velocity  vector.  The  inverse  of  this 
vector  la  the  relative  wind.  [kef.  5tp.  4] 


Figure  4.  HUD  With  Velocity  Vector  Symbol 

[kef.  6:p.  ] 
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Plgur*  B.  HUD  With  Mr  Vtloelty  V»otor 


B.  Sink  Xndloatlon 

The  elroraft*!  bink  englt  !■  tiht  engl*  betKttn  true 
vertlael  above  the  earth* a  eurfaof  end  the  plane  defined  by 
the  elrereft'a  vartlaal  end  longitudinal  exee.  The  uea  of 
•  bank  index  eymbol  on  the  HUD  haa  been  reaommanded  for 
preolelon  inatrument  flight.  The  index  ie  an  arrow 
pointing  either  at  the  aky  or  at  the  earth,  attached  to  the 
velocity  vector  laee  Figure  BK  It  la  eonotlmea  referred  to 
aa  an  Augie  Arrow.  The  bank  index  reading  muat  agree  with 
that  ahoun  on  head-down  inatrumenta, [Ref .  Btp.  A2] 
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rlgutt  6.  HUD  With  Augl*  Arrow 


6  Attitudo  Dlrtotional  Xndioator 

Tht  oonvontlonal  tttltud*  dlmotlonol  lndla«tor 
(ADI)  is  a  primary  flight  rafaranca  InatrumanV  for  a 
varlaty  of  olvll  and  military  aircraft.  Tha  ADI  prDvldaa 
an  artifiolal  horiion  format  for  uaa  during  Inatrumant 
flight  (aoa  Figura  7)  that  allowi  tha  pilot  to  control  tha 
pitch  and  roll  of  tha  aircraft  without  visual  rafaranca  to 
tha  aarth's  horixon.  Color  coding  mayba  uaad  on  tha  ADI  to 
diff arantlata  pitch  attituda  abova  and  balow  tha 
rapraaantation  of  tha  horiaon.  tRaf.  Stp.  2] 


Fi0ur«  7.  Standtrd  Attltud*  Dirtctlonal  Indicator 

[Rtf.  8:p.  7] 


7.  Rdvltory  Labtlt  and  Ltgtnda 

Words  on  tho  HUD  may  olvs  Immsdlats  information.  Kn 
oxamplt  Includta  dsacrlptlvs  vorda  or  commands  such  aa 
"CLIMB"  whsn  ths  aircraft  is  at  an  sxtrsms  noss  up  position 
(ass  rigurs  8).  Hoxsvsr,  tho  actual  words  muat  bo 
conoiatont  with  what  ths  aircraft  la  actually  doing. 

[Rsf.  7sp.  3] 

B .  Symbol  Color 

HUD  formats  prossntly  all  art  monochromatic.  That 
la,  groan  aymbola  art  dlaplaysd  on  a  claar  background.  Uas 


Flgura  8.  HUD  With  Indlcattd 

(Rte.  Btp.  B7] 


o£  othor  colon  on  tho  HUD  boon  propoiod,  but  proionto 
probloffli. 

If  colon  ar*  uatd  on  h««d-up  formats  they  must  ba 
conslstant  In  maaning  with  thosa  usad  on  haad-down 
Inatrumanta.  Each  color  usad  must  ba  aasassad  for 
accaptabla  contrast  against  all  llkaly  background 
conditions.  In  a  dagradad  or  monochromatic  moda.  a  color 
display  must  ramaln  laglbla  and  unambiguous.  Colors  should 
only  ba  usad  If  an  Improvamant  ovar  monochroma  has  baan 
shown.  [Rat.  7ip.  3] 
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C.  RBLATBD  STUDIES 

1.  H«ad-Up  Display  Studlsa 

There  has  been  concern  over  HUD  symbology  since  the 
1970s  ehen  military  pilots  started  using  HUDs  for  routine 
instrument  flight.  In  1976  the  Air  Force  Instrument  Flight 
Center  conducted  a  survey  to  determine  the  degree  to  vhich 
HUDs  were  used  and  problems  that  were  encountered  with 
them.  The  conclusions  Included  concern  over 

standardisation  of  HUD  formats  and  symbology  when  used  as  a 
primary  flight  reference.  A  pilot  factors  program  was 
suggested  to  determine  (1)  whether  HUDs  are  appropriate  to 
use  as  a  primary  flight  reference  system  and  12)  what 
symbology  and  format  are  required  for  the  HUD  to  be  ured  as 
primary  flight  reference.  [Ref.  9:p.  2]  In  a  survey  of  280 
pilots  flying  HUD-equipped  airplanes,  a  tendency  of  pilots 
towards  disorientation  was  reported  [Ref.  10:p.  1]. 

A  related  study  at  the  Naval  Air  Test  Center  (NATO 
evaluated  the  utility  of  a  workload  assessment  device  to 
measure  pilot  workload  for  approach  and  landing  tasks.  The 
study  revealed  a  trend  towards  more  mental  reserve  capacity 
when  pilots  were  flying  while  using  a  predominantly 
pictorial  and  symbolic  HUD  configuration,  compared  to 
conventional  HUD  formats  with  graphical  scales  and 
alphanumeric  information.  [Ref.  lisp.  5] 

Problems  with  recovery  from  unusual  attitudes  whan 
a  HUD  is  used  have  bean  recognized  for  many  years.  Several 
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•tudltta  ccnparing  various  HUD  formats  and  symbology  have 
been  carried  out  by  human  factors  engineers.  These  studies 
have  included  variables  related  to  cognitive  processes 
Involved  in  perception  as  well  as  to  HUD  symbology. 

Several  military  standards  have  been  adopted 
related  to  HUD  and  other  display  symbology.  Nonetheless, 
symbology  variations  continue  to  exist.  The  design  of  HUD 
pitch  scales  on  the  pitch  ladder  has  bean  of  major  concern. 
HUD  pitch  scale  symbols  have  been  shown  to  have  little 
pictorial  realism  based  on  studies  at  the  Naval  Air 
Development  Center  (NADC)  [Ref.  8:p.3].  Redundant  pitch 
cue  combinations  have  been  found  to  improve  roll-recovery 
decision  making.  Horizon**pointlrig  "tails"  have  bean 
demonstrated  to  be  superior  to  nadir-pointing  "tails"  on  a 
pitch  decision-making  task  [Ref.  3sp.  14-7]. 

To  support  standardization,  four  separate 
experiments  were  conducted  with  non-aircrew  subjects 
evaluating  pitch  scale  numerals,  pitch  bars,  local  versus 
global  features  (design  of  symbols  attached  to  pitch  bars), 
and  roll  and  horizon  Interpretation  [Ref.  3:p.  14-1].  The 
HUD  formats  and  tasks  studied  were  somewhat  simpler  than 
those  actually  used  in  aircraft.  The  formats  presented 
only  parts  of  the  information  normally  displayed  on  HUDs; 
tasks  performed  by  the  operators  were  only  a  subset  of 
pilot  tasks,  although  they  included  a  critical  part  of  the 
operator's  total  HUD-related  tasks.  Pilot  reactions  to 
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unusual,  unexpsctsd  attitudes  were  observed  end  evaluated 
In  these  studies.  Experimental  evidence  from  these  studies 
supports  adoption  of  the  following  HUD  pitch  scale  design 
characteristics  (sea  Figure  9): 

1.  Continuous  positive  above-tha-horlzon  pitch  bars  and 
broken  (dashed)  negative  below-the^horlzon  pitch 
bars. 

2.  Numerals  on  the  aides  of  the  pitch  scales,  above  or 
below  but  not  aligned  with  the  pitch  bar  extremities. 

3.  Negative  signs  for  negative  pitch  scale  numerals. 

4.  Horizon-pointing  tails  and  pitch  bars  sloping  towards 
or  away  from  the  horizon,  depending  on  attitude. 

A  combination  of  horizon-pointing  tails  and  horizon-sloping 

pitch  bars  may  be  the  safest  and  most  effective  design 

solution.  [Ref.  3:p.  14-8] 

In  response  to  a  questionnaire  administered  at 

NATC,  one-third  of  the  r/A-18  pilots  queried  gave  below 

average  ratings  for  the  HUD  as  the  primary  attitude 

reference  for  quick  interpretation  of  unusual  attitudes 

[Ref.  12:p.  7],  More  specifically,  six  pilots  reported 

that  the  pitch  bars  on  the  pitch  ladder  were  difficult  to 

interpret  In  nose-high  and  nose-  low  attitudes.  Reasons 

for  this  Include  the  rapid  movement  of  the  pitch  bars  and 

the  use  of  dashed  pitch  bars  below  the  horizon  line  that 

look  very  similar  to  the  solid  lines  above  the  horizon. 

Further  study  was  done  by  the  Air  Force  In  1987  on 

recognition  of  and  recovery  from  unusual  attitudes.  The 

experiment  required  pilots  to  recover  from  artificially 
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1.  Continuous  Positive 
Above-the-horizon  bars 

2.  Brokan  negative  below- 
the-horizon  bars 

3.  Numerals  alignsd  above 
pitch  bars  extremities 

4.  Negative  sign  for  below- 
horizon  scale 


5.  Horizon-pointing  tails 

6.  Horizon-pointing  pitch 

bars 


7.  Nadir-pointing  pitch 

bars 


Figure  9.  Recommended  HUD  Pitch  Scale 
Design  Characteristics 
[Ref.  3:p.  14-14] 


Induced  unusual  attitudes  using  various  HUD  formats.  All 
the  symbologies  were  compered  to  baseline  F/A-18  HUD 
symbology.  A  post-flight  guestionalre  was  also  completed 
by  each  subject  pilot,  rating  the  display  in  terms  of  ease 
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of  flying,  «as«  of  maintaining  spatial  orientation,  and 
overall  rating  of  the  display  [Ref.  7:p.  8] 

The  results  of  this  Air  Force  study  indicate  that  a 
two-to-one  pitch  saala  compression  is  advantageous. 
Additional  bank  information  and  an  upward  pointing  cue 
(Augla  Arrow)  on  the  velocity  vector  are  effective. 
Slanted  pitch  ladder  bars  pointing  toward  the  horizon 
enhance  recovery  from  unusual  attitudes.  Automatic 
deletion  of  the  velocity  vector  symbol  at  high  angles  of 
attack  also  enhances  recovery.  Five  composite  symbologies 
were  recommended  for  further  evaluation: 

1.  Composite  I  (figure  10): 

a.  F/A~18  style  pitch  ladder  below  the  horizon  and 
conventional  pitch  ladder  above  (pitch  ladder 
modified  to  indicate  heading  whan  pitch  exceeds 
4-/-60  degrees;  no  pitch  precession  passing  zenith 
or  nadir) . 

b.  Compass  heading  on  the  horizon  line  with  digital 
heading  displayed  above  the  waterline  symbol. 

c.  Bank  index  at  the  top  of  the  display  format  free 
to  move  through  360  degrees  (enhanced  when  bank 
exceeds  -fZ-eo  degrees)  . 

d.  Automatic  change  to  two-to-one  pitch  scaling  and 
display  of  a  roll  arrow  on  the  velocity  vector 
symbol  (or  waterline)  when  pitch  exceeds  30 
degrees  or  bank  exceeds  60  degrees. 

e.  Deletion  of  velocity  vector  automatically  at  high 
angle  of  attack  (if  Augie  Arrow  or  rky  arrow  is 
being  displayed,  display  waterline  s:*mbol). 

2.  Composite  II : 

a.  Identical  to  Composite  I  except  F/A~18  style 
pitch  ladder  with  slanted  pitch  bars  above  and 
below  horizon  (pitch  ladder  modified  to  indicate 


17 


heading  when  pitch  exceeds  -t-/-  60  degrees;  no 
pitch  precession  passing  zenith  or  nadir). 

3.  Composite  III: 

a.  Identical  to  Composite  I  except  fulltime  one-to- 
one  pitch  scaling. 

4.  Composite  IV: 

a.  Identical  to  Composite  I  except  fulltime  two-to- 
one  pitch  scale  compression. 

5.  Composite  V: 

a.  Identical  to  Composite  I  except  fulltime  Augie 
Arrow.  [Ref.  7:p.  39] 

2.  Attitude  Directional  Indicator  Studies 

Discussions  with  pilots,  psychologists,  and 
engineers  at  tIATC  In  April  1985  indicated  that  the 
Attitude  Directional  Indicator  (ADI)  ball  is  the  preferred 
choice  for  attitude  Indicator  instrument  [Ref.  2:p.  3]. 
The  current  ADI  ball  In  the  F/A-18  Is  small  and  poorly 
located  (near  the  pilot's  right  )cnee)  .  Using  this 
information  and  results  from  the  Royal  Air  Force  1984  study 
[Ref.  3],  NADC  compared  the  F/A-18  HUD  pitch  ladder  to  an 
ADI  for  the  length  of  time  required  to  recover  from  unusual 
attitudes.  Two  experiments  were  conducted. 

The  first  experiment.  Involving  non-pilots,  was  a 
comparison  of  two  pitch  ladder  formats  and  a  pictorial 
representation  of  an  ADI  ball  in  a  static  display  (see 
Figure  11) .  The  ability  of  these  formats  to  aid  the 
subject  in  deciding  how  to  recover  from  unusual  attitudes 
was  assessed. 
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Flgur*  11.  Static  Display  of  Aircraft 
Attitude  Directional  Indicator  Used  in  NADC  Studies 

[Ref.  8tp.  83 


The  aecond  experincnt.  Involving  both  non-pilots 

and  pilots,  tested  the  format  of  the  current  F/A-18  pitch 

ladder  (Figure  12)  and  an  ADI  ball  in  a  medium-fidelity, 

ground-based  simulator  in  the  Crewstation  Evaluation 

Facility  at  NADC.  The  static  display  ADI  ball  resulted  in 

significantly  faster  decision  times  and  was  superior  to  the 

pitch  ladder  in  aiding  recovery  from  unusual  attitudes.  A 

revised  pitch  ladder  (Figure  13) ,  based  on  the  four 

concepts  noted  above  for  Improved  HUD  displays,  did  not 

surpass  the  current  pitch  ladder  in  decision  times. 

Recommendations,  baaed  on  the  results  of  these  tHo 
experiments  would  be  to  include  an  electromechanical 
ADI  ball,  in  an  optimal  location,  within  the  display 
suite  and  have  it  act  as  the  primary  instrument  for 
attitude.  If  a  pitch-ladder  presented  on  a  HUD  is  the 
primary  flight  Instrument,  as  it  is  in  the  F/A-18,  an 
ADI  ball  should  be  present  as  a  secondary  instrument  in 
a  location  such  that  it  would  reguire  very  little  eye 
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Flgur*  12.  Currtnt  F/A-18  HUD  Pitch  Ladder  Uaad  In 
NADC  Studies  that.  8tp.  8] 


r 
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Figure  13.  Revised  F/A-18  HUD  Pitch  Ladder  Used  In 
NADC  Studies  [Ref.  8:p.  8] 


translation  to  cross  reference  between  the  two 
displays.  [Ref.  8ip.  23] 

The  results  of  both  experiments  suggest  that  the  Inclusion 
of  an  ADI  located  within  the  central  field  of  view  would 
aid  in  unusual  attitude  recovery  and  Improve  pilot  spatial 
orientation. 


NADC  has  parformad  raaaarch  to  datarnlna  whether 
the  addition  of  an  elactronlcally-oenerated  ADI,  displayed 
directly  below  the  MUD,  would  aid  pilots  In  recovery  from 
unusual  attitudes.  The  study  compared  three  display  formats 
for  their  ability  to  aid  pilots  In  recovery  from  unusual 
attitudes.  The  first  format  was  the  graphic  representation 
of  an  ADI  (Figure  11).  The  second  format  was  that  used  on 
the  F/A~18  HUD  (Figure  12)  [Ref.  8:p.  6].  The  third 
format  was  the  concurrent  use  of  the  HUD  and  the  ADI.  The 
electronically  generated  ADI  again  reaultad  In 
significantly  faster  recovery  times,  whan  compared  with  the 
current  F/A^IB  HUD  format. 

The  reasons  for  this  result  might  Includes 

1,  The  superiority  of  color  coding  on  the  ADI  for 
denoting  s){y  and  ground,  versus  solid  and  dashed 
pitch  bars  on  the  HUD. 

2.  A  slower,  yet  more  controllable  rate  of  movement  of 
the  pitch  scale  on  the  ADZ,  compared  to  the  rapid 
movement  of  the  HUD  ^  tch  ladder. 

Other  advantages  of  the  ADI  format  Include  an 
easily  distinguishable  horlson  line  and  ease  In  obtaining  a 
snapshot  assessment  of  the  aircraft's  attitude  [Ref.  22p. 
26] .  The  concurrent  use  of  the  HUD  and  the  ADI  proved  to 
be  complementary  during  unusual  attitude  recovery.  During 
recovery  from  extreme  pitch  attitudes,  the  strengths  of 
each  format  compensated  for  the  weakneeses  In  the  other. 
The  results  of  this  study  Indicate  that  the  addition  of  a 
centrally-located  ADI  display  in  the  F/A-18  would  improve 
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pilot  ptirf ormanet  during  unusual  attitude  recovery.  The 
XDI  would  allow  pllota  to  conveniently  eroaecheck  for 
attitude  information  diaplayed  on  the  HUD. 

Kennedy  haa  proposed  an  enhanced  ADI  display,  as 
ahown  in  Figure  14.  Thle  would  display  ADI  symbology  on 
one  of  the  F/A-lt'a  two  Digital  Display  indicator  (DDI) 
multipurpose  displays.  The  enehanoed  ADI  combines 
available  ADI  and  HUD  data  in  a  location  close  to  the 
pilot's  primary  instrument  scan.  The  display  provides  a 
realistic  I  pseudo  three-dimensional  format  similar  to  the 
3-axi8  gyro  used  in  flight  training.  [Ref.  4tp.  13] 

The  enhanced  ADI  combines  information  from  two 
head-down  displays  Into  a  single  format.  It  provides  nose 
attitude,  bank  angle,  heading,  turn  and  slip  needle, 
altitude,  airspeed,  angle  of  attack,  load  factor  (g) , 
maximum  g  over  4.0,  and  horizon-pointing  arrows  based  on  a 
Swedish  design.  The  improved  ADI  is  expected  to  be  useful 
during  normal  operations  as  well  as  for  night  and 
instrument  flying. 

D.  OBJBCTIVBS  OF  STUDY 

The  purpose  of  this  study  is  to  determine  the  HUD 
design  variables  and  overall  display  format  that  best 
assist  F/A-18  pilots  in  maintaining  or  rapidly  regaining 
spatial  orientation. 

Experimental  studies  have  suggested  various  design 
variables  and  formats  that  assist  declslon-maklng 
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rigv\r«  14 «  Inhanocd  Attltudt  Dlrtetlpnil  IndloAtor 

(R»f.  4] 

p«r£orin«ne«.  A  survey  o£  r/A-18  pilots  has  bs«n  conducted 
to  sssess  their  opinions  on  these  design  verisbles  end 
formsts  in  e  static  environment,  based  on  their  experience. 
It  is  hypothesised  that  key  design  variables  and  formats 
can  be  identified  as  a  result  of  the  survey.  These  can  be 
recommended  for  simulation  testing  and  as  performance-based 
evidence  for  HUD  standardisation. 

B.  BCOPI 

This  study  is  limited  to  those  specific  design 
variables  and  formats  that  previously  have  been 
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hypothtsiscd  to  havo  aionifleant  affacta  on  daclaion-'-making 
parfornanca  whan  a  pilot  muat  racovar  from  an  unusual 
aircraft  attituda.  Opinions  hava  baan  collactad  on 
apacifio  varlablas  that  aid  In  situational  awaranaaa,  as 
aupportad  by  axparimantal  study.  Dua  to  unavailability  of 
taallltlasi  axparimantal  tasting  of  tha  favorad  formats  in 
a  dynamic  flight  simulation  by  f/K-li  pilots  has  not  baan 
earriad  out  for  this  study. 


II.  CONDUCE?  OP  STUDY 


A.  STUDY  MITHODOLOOY 

Two  aurvoyt  wara  oonduatad  for  thla  study.  Tha  purpoaa 
of  Burvay  1  (Appandlx  A)  was  to  laolata  apacltlc  aynbola 
that  ara  praaant  or  eould  ba  praaant  on  tha  HUD  format  that 
may  aaalat  pilots  In  raoovary  from  unuaual  attltudaa. 
Survay  a  than  was  oonduotad  to  obtain  pilot  vlawa  on 
display  formats  inoorporatlng  tha  prafarrad  symbols. 

1 .  Survay  1 

Survay  1  Inoludad  guastlons  on  tha  pitch  ladder 
tall  formats  and  their  location  on  tha  pitch  ladder.  Tha 
location  is  important  sinoa  tha  pilot  has  time  only  for  a 
quick  look  at  tha  MUD  symbols  to  datarmina  his  position 
while  in  an  unususl  attitude. 

Tha  pitch  ladder  bars  and  how  they  might  ba  angled 
wara  examined.  Tha  pitch  ladder  bars  provide  visual  cues 
for  determining  tha  aircraft's  angle  of  attack  with  respect 
to  tha  horiaon. 

A  number  is  shown  on  each  pitch  bar  to  indicate  tha 
degrees  above  or  below  tha  horison  raprasantad  by  that  bar. 
Tha  location  and  readability  of  tha  numbers  ara  important 
duo  to  tha  need  to  interpret  them  with  only  a  quick  look. 
Possible  locations  of  the  numbers  wara  examined. 


Th«  us«^!uXn*ift  of  a  nagatlv*  algn  adjacent  to  the 
beloe^horlson  number  alao  waa  examined.  Thla  additional 
viaual  cue  may  aaaiat  In  determining  attitude. 

Varloua  typea  of  velocity  vector  aymbola  and  the 
preaence  of  an  Jlugle  Arrow  were  included  in  the  aurvey. 
Pllota  were  aaked  how  helpful  each  of  theae  would  be  during 
recovery  from  unuaual  attitudea.  The  uaefulneaa  of  worda 
that  might  be  preaent  on  the  HUD  when  the  aircraft  la  In 
extreme  attitudea  (CLIMB  or  DIVB)  waa  the  final  area 
examined. 

2 ,  Survey  2 

The  purpoae  of  Survey  2  (Appendix  B)  waa  to 
incorporate  the  preferred  aymbola  from  the  reaulta  of 
Survey  1  into  overall  HUD  diaplay  formate.  Queatlona 
regarding  the  format  of  the  ADI  alao  were  included. 

The  direction  the  Augie  Arrow  ahould  point  (toward 
the  ground#  horiaon#  or  aky)  waa  examined#  becauae  proper 
interpretation  of  the  arrow  during  a  quick  look  la 
necoanary.  The  poaalble  uae  of  a  contraating  color  for  the 
below~horiaon  pitch  ladder  aymbola  waa  examined.  Color  la 
a  good  viaual  cue#  eapeoially  if  the  diaplay  la  moving 
rapidly  and  the  daahed  linea  become  blurred. 

Pilot  opiniona  were  collaotad  concerning 
preaentatlon  of  word  cuea  on  the  HUD  while  the  aircraft  ia 
at  an  «Atreme  angle.  Word  cuea  can  be  preaented  aa  commanda 
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(CLIMB  or  DIVE)  or  ••  Informotion  (NOSE  UP  or  NOSE  DOWN) .  A 
compariaon  of  thoao  typoa  daaorlptlva  wording  was  made. 

Pilots  wars  aa)cad  thair  prafaranca  for  rataining  or 
dalating  tha  valoclty  vactor  whila  at  exbrama  angina  of 
attack.  This  factor  waa  axamlnad  baoauaa  of  tha  importanca 
of  Including  only  thoaa  aymbola  on  tha  HUD  that  tha  pilota 
think  ara  nacanaaryi  and  daoluttaring  tha  format  by 
ramoving  tha  rast. 

Displaying  tha  balow-horizon  pitch  laddar  aa  a 
"sawtooth"  lina  haa  baan  proposad.  Pilot  opinions  wara 
aolicitad  on  this  typa  of  symbology  and  its  uaafullnaas  aa 
a  visual  oua  in  racovary  from  axtrama  attitudaa. 

riva  pcsaibla  ADI  formats  also  wara  axaminad. 
Rasaarch  and  informal  discussion  with  pilots  and  aciantista 
indicata  that  tha  ADI  providas  good  visual  cuas  for 
racovary  from  unusual  attitudaa  and  tor  routine  flight  if 
tha  HUD  doaa  not  function  proparly.  Pilots  wars  askad  to 
indicate  which  of  tha  five  formats  they  would  prefer  to 
hava«  in  conjunction  with  a  standard  f/A-lB  HUD  format. 

B.  PILOTB  8URVIYID 

Tha  pilots  surveyed  wara  all  P/A-IS  operational  pilots 
from  VFA~iaB  and  vrA**113  squadrons  at  Lamoora  Naval  Air 
Station.  California.  Sixty  pilots  responded  to  tha  first 
quastionaira.  The  average  total  flight  hours  for 
participants  was  1000~a000  hours.  The  average  tactical  jet 

hours  was  1000  hours.  Tha  average  F/A-^IB  hours  was  loss 
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than  500  hours.  Pour  of  th«  rospondonts  had  combat 
axparianoa. 

Flfty-alx  pilots  raapondad  to  ths  second  quostlonaire. 
They  averaged  1000-2000  total  flight  hours.  The  average 
tactical  jet  hours  was  1000  hours.  The  average  F/X-18 
houra  was  less  than  BOO  hours.  Four  of  the  respondents 
had  combat  axparianoa. 

C.  8YMBOLOOXB8  AND  FOMIXTS  BVAhUATID 

The  symbologies  and  formats  that  ware  evaluated  during 
this  study  are  those  that  assist  In  maintaining  situational 
awaranaas.  That  ls«  these  symbols  help  the  pilot  recognize 
ths  status  of  his  own  aircraft  and  its  relationship  to  the 
outside  world.  These  are  illustrated  In  Figure  3-8  and  in 
Appendices  A  and  B. 

D.  8URVIY  ADMINISTRATION 

1.  Survey  1 

The  first  survey  was  administered  at  Lamoore  Naval 
Air  Station  on  two  separate  occasions  but  under  similar 
conditions.  The  first  administration  was  to  15  pilots  in 
the  VFA-113  squadron.  The  second  was  to  VFA-135>  with  45 
pilots  responding.  Appendix  A  provides  the  survey  forma 
used. 

Bach  format  was  Illustrated  on  the  survey  form  and 
also  was  presented  visually  via  transparancles  projected 
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from  an  ovorhoad  projaetion  machlna.  Participant!  wara  not 
allowad  to  dlacusa  tha  apaclflc  formats  or  tha  quaationa. 

Tha  first  survay  containad  thraa  quastlona 
ragarding  tha  pitch  laddar  tall  formats,  position  of  degree 
numerals,  and  velocity  vector  aymbol  cues.  Pilots  vara 
required  to  rata  tha  symbols,  that  is,  to  assign  aach  of 
the  llluatratsd  inatancsa  to  a  ranked  category,  using 
categorical  judgement.  Tha  daeoriptora  that  ware  aesoclatad 
with  each  category  ware  related  to  the  quality  of 
information  that  each  symbol  poeaeasas.  These  dasoriptions 
aasistad  tha  pilot  with  his  task  of  rating  those  symbols. 

Tha  other  questions  on  tha  first  survey  asked  the 
pilots  to  choose  their  favored  format,  when  given  two 
options.  Tha  specif ie  formats  illustrated  two  kinds  of 
pitch  laddar  bar  angles,  prasanca  or  absence  of  a  negative 
sign  associated  with  balow-horison  pitch  bars,  and  use  of 
words  as  visual  cues. 

2.  Survey  2 

Tha  second  survey  was  mailed  to  VFA-113  and  VFA~125 
for  administration  by  LCDR  Dave  Kennedy,  Safety  Officer, 
and  LCDR  Bob  Woods,  Training  Officer,  respectively.  These 
officers  were  instructed  to  administer  tha  survey  in  a 
fashion  similar  to  that  done  with  the  first.  The  formats 
presented  in  the  second  survey  ware  not  presented  visually 
from  an  overhead,  but  were  Illustrated  in  tha  survey  forms 
(see  Appendix  B) . 
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Thtt  questions  in  th«  Becond  Burvey  ankad  tha  pllota 
to  chooaa  batwaan  two  or  thraa  poaalble  HUD  formats.  The 
aurvey  Included  queitlona  on  (1)  where  an  Augle  Arrow 
ahould  point  (toward  the  ground,  horizon,  or  aky)  If  It 
ware  preaent  on  tha  HUD  format,  (2)  whether  tha  below- 
horizon  pitch  ladder  ahould  be  color  coded,  (3)  what  types 
of  daaoriptlve  wording  ahould  be  used  when  tha  aircraft  ia 
in  an  extreme  angle  of  attack,  (4)  whether  the  velocity 
vector  ahould  be  present  at  extreme  angles  of  attack,  and 
(5)  whether  further  research  should  be  done  on  an 
experimental  below-horizon  pitch  ladder. 

The  last  question  asked  the  pilots  to  choose 
between  five  ADI  and  HUD  formats  in  combination.  The  ADI 
formats  that  were  illustrated  Included  the  format  that  ia 
currently  used  on  the  F/A-18  aircraft  along  with  four  other 
programmable  options. 


III.  DATA  ANALYSIS 


A.  CATEGORICAL  RATING  ANALYSIS  TECHNIQUE 

Th«  data  analyaia  method  used  to  analyze  survey  results 
for  questions  1,  3,  and  S  in  the  first  survey  is  a  scaling 
method  which  uses  categorical  ratings  provided  by  judges. 
The  technique  constructs  an  interval  scale  based  on  these 
categorical  ratings.  The  Interval  scale  includes  not  only 
the  Instances  but  also  the  bounds  between  the  categories. 
In  this  case,  instances  are  the  specific  HUD  symbols  that 
pilots  were  asked  to  rate;  these  make  up  the  rows  of  the 
frequency  array.  The  rating  categories  define  the  possible 
levels  of  information  quality  that  the  various  symbols 
provide  for  the  pilot.  [Ref.  13] 

Five  rating  categories  were  used  for  this  study:  (1) 
Terrible  Quality,  (2)  Poor  Quality,  (3)  Fair  Quality,  (4) 
Good  Quality,  and  (5)  Excellent  Quality.  No  assumptions  are 
made  about  the  relative  Interval  sizes  for  the  categories. 
The  categories  are  understood  to  be  a  mutually  exclusive 
set  of  successive  intervals  which  collectively  exhaust  all 
possible  responses. 

The  ten-step  procedure  constructs  an  Interval  scale 
that  includes  the  Instances  and  bounds  between  categories 
[Ref.  14;p.l4].  The  ten-step  method  requires  several 
assumptions.  The  first  assumption  is  that  the  pilot's 
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judg«in«nts  about  the  acale  value  of  an  instance  1  can  be 
expreaead  as  a  normally  distributed  random  variable  with 
mean  ut  And  variance  ot  * • 

The  second  assumption  is  that  pilots  view  the  continuum 
of  values  for  instances  as  categories  that  are  b;.o)cen  into 
auccasslva  intervals,  each  having  an  upper  bound  or 
boundary  except  the  Excellent  Quality  category.  The 
pilot's  judgement  about  the  category's  upper  bound  is  also 
expressed  as  a  normally  distributed  random  variable. 
Category  j  has  a  normally  distributed  upper  bound  with  mean 
b^j  and  variance  Vj*. 

The  third  assumption  is  that  the  pilot's  judgements 
about  the  scale  values  of  instances  are  stochastically 
independent  random  variables  that  have  a  correlation 
coefficient  of  zero  for  all  pairs  i  and  j. 

The  fourth  assumption  is  that  all  category  bounds  have 
the  same  variance,  that  is.  Vj*  »  c  for  all  j.  [Ref.  14] 

B.  TBN-3TBP  PROCEDURE  FOR  OBTAINING  SCALE  VALUES 

The  ten-step  procedure  described  below  is  taken  from 
Reference  14.  It  is  a  method  that  yields  scaled  numerical 
data  for  the  pilots'  categorical  responses  concerning  the 
HUD  variable  types. 

1.  Arrange  the  raw  frequency  data  in  a  table  Fi j  where 
the  rows  are  Instances  i  and  the  columns  are 
categories  j .  The  columns  should  be  arranged  in 
ascending  order  of  category  value,  so  that  the  last 
column  to  the  right  represents  the  most  favorable 
category. 


33 


2.  Computa  ralatlva  cumulative  frequenclaii  for  each  row, 
and  record  theae  In  a  new  table  Pi j  where  Pij  is  the 
proportion  of  pilots  judging  Instance  i  in  or  below 
category  j .  The  values  in  the  right  hand  column  of 
Pij  will  equal  one  and  that  column  may  bo  omitted  for 
computational  purposes. 

3.  Compute  the  Zij  array  by  treating  the  Pu  values  as 
leftward  areas  under  a  Normal  (0,1)  curve  and  find 
the  Z  values  for  these  areas  in  a  table  of  values  of 
the  normal  or  Oaussian  distribution. 

4.  Compute  the  row  average  Zi  for  each  row  1  in  the  Zi j 
array. 

5.  Compute  the  column  average  bj  for  each  column  j  in 
the  Zij  array.  The  bj  column  averages  are  the  upper 
bound  values  of  category  i  on  the  scale. 

6.  Compute  the  grand  average  b  of  all  the  values  in  the 
Ztj  array.  This  is  done  by  averaging  the  column 
averages  b j . 

7.  Compute  the  sum  of  squares  for  the  column 

differences: 

B  "  I  (bj  -  b)* . 

J  ■  1 

8.  Compute  the  sum  of  squares  of  the  row  differences: 

■  »  I  _ 

At  -  I  (Zi4  -  Z» )«  . 

1  ■  I 

9.  Compute  f (B/Ai  )  for  each  row  to  give  an  estimate  of 
/ (oi  *  +c)  . 

10.  Compute  St  -  b  -  Zi  /{B/Ai  )  for  each  row  i.  The  Si 

values  are  the  scale  values  of  the  Instances,  and  are 
on  the  same  Interval  scale  as  the  category  bounds  bj. 
A  linear  transformation  y  ■  a  +  Bn ,  B>0  may  be 
performed  to  move  the  scale  where  it  is  desired.  The 
same  transformation  must  be  used  to  move  the  instance 
values  and  the  categ  ^ry  bounds. 
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C.  OBTAINING  8CALB  VALUB8  FROM  THB  CATEGORICAL  SURVEY  DATA 
An  axamplt  of  the  tan-stap  procedura  for  tha  pilot 
■urvay  will  ba  shown  atap  by  atap  for  quaation  5  on  Gurvay 
1.  Tha  aoallng  problam  la  brokan  Into  dlffarant  problama 
baoauaa  tha  Zu  array  muat  ba  oomplata,  as  daacrlbad  in 
rafaranca  13. 

1.  Tha  raw  fraquaneiaa  ara  glvan  aa  illuatratad  in  Tabla 
1.  Tha  oatagorlaa  T,  P,  F,  Ot  and  E  rapraaant 
tarribla.  poor,  fair,  good,  and  axcallant  quality  of 
Information  for  aach  varlabla. 


TABLE  1.  FREQUENCY  DATA  FOR  PROBLEM  B,  Ft j  . 

(Saa  Appandlx  A  for  llluatratlona  of  tha  aymbola  Idantlflad 
hara  aa  A,  B,  C,  D,  E,  and  F.) 


Symbol 

T 

P 

F 

0 

B 

A 

4 

14 

7 

22 

11 

B 

25 

31 

2 

0 

C 

11 

27 

7 

9 

D 

17 

29 

7 

6 

E 

8 

20 

15 

14 

r 

3 

7 

14 

24 

10 

2.  Tha  ralatlva  cumulativa  fraquanclaa  ara  computad  for 
aaeh  row,  aa  Illuatratad  In  Tabla  2.  Tha  laat  column 
will  always  ba  a  vactor  of  onaa  and  may  ba  omittad. 


TABLE 

2.  RELATIVE 

CUMULATIVE 

FREQUENCY  DATA, 

Pu 

bdh 

P 

V 

0 

A 

0.07 

0.31 

0.43 

0.81 

B 

0.43 

0.96 

1.00 

C 

0.19 

0.66 

0.78 

0.94 

D 

0.29 

0.79 

0.88 

0.14 

0.48 

1.00 

0.05 

0.17 

0.41 

0.83 
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3.  Th«  ralativtt  fraquanolai  than  traatad  aa  laftward 
araaa  undar  a  Normal  (0,1)  ourva.  Tha  z  valuaa  for 
tha  araaa  ara  raoordad  In  Tabla  3.  Tha  valuaa  givan 
in  Tabla  3  ara  dlvidad  Into  two  acallng  problama 
bacauaa  nona  of  tha  pllota  gava  good  or  axcallant 
ratinga  for  thraa  of  tha  varlablaa. 


TABLE  3. 


j 


2  VALUES  rOR  THE  NORMAL  DISTRIBUTION 


Symbol 

T 

P 

F 

0 

A 

>1.48 

-0.80 

-0.17 

0.88 

C 

-0.88 

0.40 

0.76 

1.48 

F 

-1.63 

-0,94 

-0.33 

0.94 

B 

-0.18 

1.76 

3.90 

D 

-0.56 

0.81 

1.18 

e: 

-1.08 

-O.OS 

3.90 

4.  Tha  row  avaragaa,  Zt ,  ara  eomputad,  aa  ahown  in  Tabla 
4.  Tha  aolumn  avaragaa,  bj ,  ara  alao  oomputad  in 
Tabla  4. 


TABLE  4.  RON  AND  COLUMN  AVERAGES 


Zu 

T 

F 

F 

0 

Zi 

-0.50 

-0.17 

0.88 

-0.33 

0.40 

0.76 

1.48 

0.44 

-0.94 

-0.33 

0.94 

-0.46 

-1.33 

-0.35 

0.13 

1.10 

B 

-0.18 

1.76 

3.90 

1.83 

D 

-0.56 

0.81 

1.18 

0.48 

B 

-1.08 

-0.05 

3.90 

0.92 

bj 

-0.60 

3.53 

3.99 
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5.  Th«  grand  «v«r«o«,  b,  la  eomputad.  For  thla  •xample, 
that  calculation  lot 

bAcr  -  (-1.33  -0.346  +  0.123  +  l.l)/4  -  -0.113 

biDi  -  (-0.60  2.52  2.99)/3  -  1.64. 

6.  Tha  auitt  of  squaraa  of  tha  column  avaragaa,  Bf  la 
calculatadi 

ra«l  „ 

B  •  S  (bj  -  b)> 
j-l 

BAor  -  (-1.33  -  -0.ll3)i  (-0.349  -  -0.113)* 

(0.123  -  -0.113)*  ■  3.059 
Bidi  •  (-0.60  -  1.64)*  4  (2.52  -  1.64)* 

4  (2.99  -  1.64)«  «  7.61. 

7.  Tha  aum  of  aquaraa  of  tha  row  avaragaa  la  calculatad 


for 

aach 

row  of 

tha  Ztj  array. 

m« 

1 

A«  ■ 

Z 

(Zu  - 

Zi  )* 

j- 

1 

Aa 

M 

(- 

1.48  - 

-0.318)*  4  (-0.50  -  -0. 

318)* 

4 

(-0.17 

-  -0.318)*  4  (0.88 

-  -0 

.318)*  »  2.84 

Ac 

■ 

(- 

0.88  - 

0.44)*  4  (0.40  -  0, 

.44)* 

4  (0.76  - 

0. 

44)*  4 

(1.48  -  0.44)*  »  2. 

.926 

Ar 

M 

(- 

1.63  - 

-0.463)*  4  (-0.346 

-  -0 

.463)* 

4 

(0.123 

••  -0.463)*  4  (1.1  ■ 

.  -0. 

463)*  -  4.15 

Ai 

■ 

(- 

0.18  - 

1.83)*  4  (1.76  -  1, 

.83)* 

4 

(3.9  - 

1.83)*  -  8.32 

Ad 

■ 

(- 

0.56  - 

0.48  )*  4  (0.81  -  ( 

).48) 

1 

4 

(1.18 

-  0.48)*  »  1.68 

Ai 

■ 

(- 

1.08  - 

0.92)*  4  (-0.05  -  ( 

).92) 

■ 

4 

(3.9  - 

0.92)*  -  13.82. 

Tha 

valua 

of  /(B/Ai)  la  calculatad 

for 

aach  row: 

Aa 

■ 

(3 

.059/2 

.64)>*  -  1.04 

Ao 

■ 

(3 

.059/2 

.926)'*  -<  1.02 

Ar 

(3 

.059/4 

.157)>*  «  0.86 

Ai  «  (7.61/8.32)*  «  0.96 
Ao  «  (7.61/1.68)*  -  2.13 
Ar  «■  (7.61/13.82)  *  -  0.74. 

9.  Tha  acala  valuaa  of  tha  varlabla  typaa  ara  glvan  for 
aach  row  by  tha  formula: 
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Si  -  b  -  Zi  /(B/Ai  ' 

Tht  valuts  for  tho  Sit  art  at  followa: 

Sa  «  -0.113  -(-0.318) (1.04)  -  0.217 
Sp  -  -0.113  -(0.44) (1.02)  -  -0.56 
Sr  «  -0.113  -(-0.463) (0.86)  «  0.285 

Si  »  1.64  -  (1.83) (0.96)  ■  -0.117 

50  -  1.64  -  (0.48) (2.13)  «  1.617 

St  «  1.64  -  (0.92) (0.74)  •  0.952. 

10.  X  linaar  tranafermation  with  tha  oQuatlon  Y  ■  o  8x, 
la  than  dona  to  put  tha  two  lata  of  valuaa  for 
quaation  5  on  tha  aama  aoala.  Trantformad  raaulta 
arai 

51  -  -1.638  +  (-0.507) (-0.117)  ■  -1.579 
Si  -  -1.638  4>  (-0.507)  (-0.8198)  •  -2.45 
8i  -  -1.638  4  (-0.507) (0.952)  -  -2.12. 

Tha  tan-atap  proeadura  for  aoallno  oatagorleal 
data  outllnad  abova  waa  appllad  to  quaationa  1.  3> 
and  5  in  Survay  1.  Tha  oolunna  of  tha  raw  traquanoy 
data  array  with  valuaa  of  aaro  had  to  ba  qroupad  with 
adjaeant  oelumna  ao  that  tha  Zij  array  would  not  be 
Inoomplata.  Tha  aoala  valuaa  ara  found  In  Appandlx  c 
and  In  flouraa  15,  16,  and  17. 


D.  8URVBY  1  DATA  ANALYSIS 

Tha  nathod  daaoribad  abova  waa  uaad  to  analyza  tha 
raaulta  from  quaationa  1,  3,  and  5  In  Survay  1. 

Tha  ramalnlnq  quaationa  (2,  4,  6,  and  7)  In  Survay  1 

raqulrad  tha  pilota  to  ehooaa  batwaan  two  format  varlablaa. 
Such  an  "althar/or"  oholoa  la  rapraaantlva  of  a  dlaorata 
distribution.  Thla  distribution  la  hypothaalaad  to  ba  a 
Binomial  Distribution  In  thla  oaaa.  If  thara  la  no 
proforanoo  for  ona  or  tha  othar,  It  la  hypothaalaad  that, 
for  aaoh  pilot,  thara  la  a  0.5  ohanoa  ha  will  ohooaa  a 
qlvan  format  varlabla.  It  follows  that 
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Pr(X  -  X)  •  (J)  p*  q*-«.  15:p.  100] 

A 

R««ult«  «r«  lnolU(A«d  In  Appendix  C. 

B.  SURVEY  a  DATA  ANALYSIS 

All  the  questions  in  Survey  a  required  the  pilots  to 
choose  one  from  enonq  two*  three,  or  five  format  variables. 
Again,  it  is  hypothesised  that  the  responses  have  a 
Binomial  Distribution.  That  is.  unless  pilots  have  a 
preference,  there  is  a  0.5  chance  of  aaleotion  for  each 
when  there  are  two  format«i^i  a  0.33  chance  for  three 
formats,  and  a  O.a  chance  for  each  with  five  formats.  It 
follows  that 

Pr(X  ■  x)  ■  (”)  p*  qo*'*  .  iRef.  IBiip.  100] 

Results  are  included  in  Appendix  D. 
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IV.  RESULTS 


K.  SURVEY  1  RESULTS 

Data  from  tha  first  aurvay  wars  analyiad  aooordlng  to 
tha  proeadura  outllnad  in  tha  pravloua  ehaptar.  and  ara 
avallabla  in  Appandlx  C.  Tha  raaulta  tor  aaoh  quaatlon  ara 
diaeuaaad  In  datall  halox. 

1.  Vltah  Laddar  "Tail"  roraats 

Quaatlon  It  Paying  attantlon  only  to  tha  HUD  pitch 
laddar  tall  formata,  rata  aaoh  of  tha  folloHlng  tail 
poaltlona  aoeordlng  to  tha  quality  of  information  and  ouaa 
thay  would  giva  you  during  raoevary  from  unuaual  attltuda. 

Tha  firat  quaatlon  aakad  tha  pilota  to  aoala  tha 
fiva  pitch  tall  formats  on  a  rating  aoala.  Tha  rating 
oatagoriai ,  aa  daaeribad  In  tha  data  analysis  saction, 
dafina  tha  poaclbla  lavala  of  information  quality  that  tha 
various  symbols  provida  tha  pilot.  Tha  pilots  ratad  ttaoh  of 
flva  symbols. 

Th<^  highast-ratad  pitch  laddar  tall  format  is  that 
which  plaoaa  both  tails  (abova  tha  horlion  and  balow  tha 
horlson)  at  tha  outar  anda  of  the  pitch  laddar.  pointing 
towards  aach  other  (aaa  Figura  Id).  Analysis  placad  this 
symbol  in  tha  Good  oatagory  (aaa  Figura  15) .  A  total  of  34 
of  tha  pilots  placad  this  symbol  in  tha  Good  or  Exoallant 
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1.  Pitch  Ittddcr  with  tails  a.  Bars  ara  laval  at 

at  outer  anda,  polntlno  horlion#  with 

toward  each  other.  anala  Ineraaaing 

with  Ineraaead 
distance  from 
horlion. 


I  .  — — »  - - -  f 

4.  No  iiagativa  sign 
present  on 
below-horlion 
pitch  bars. 

Figure  14.  Symbol i  Favored  on  the  First  Survf<,^ 


3.  Degree  numbers  placed  at 
both  outer  ends  of  both 
horlaon  bars. 
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5.  Vvloelty  Vector  with 

Auoitt  Arrow. 


5.  Vflpolty  Vector 
without  Arrow. 


6.  Word  *'CLIMB" 
preaent . 


7.  Word  "DIVE" 
preaent. 


Figure  14.  Symbola  Favored  on  the  Flrat  Burvey  (Continued) 


at  QBaIi.cr 


eat«gory.  All  oth«r  fyinbolB  rated  only  Fair  or  Poor.  Other 
data  values  can  be  found  In  Appendix  C. 

Pilot  comments  Included  support  for  minimal  clutter  on 
the  HUD,  such  as  "Do  not  want  too  much  clutter  In  the 
middle  of  the  HUD". 

2.  Pitch  Ladder  Bar  Angles 

Question  2>  Paying  attention  only  to  the  angle  of 
the  pitch  bars,  circle  the  format  that  would  give  you  the 
better  quality  of  information  during  recovery  from  unusual 
attitude. 

The  second  question  had  the  pilots  choose  their 
favored  format  when  given  two  illustrated  options.  The 
preferred  option  (B3  of  the  pilots)  showed  the  pitch  ladder 
bars  level  at  the  horiien,  with  the  angle  of  the  bars 
increasing  with  increased  distance  of  the  aircraft  from  the 
horizon  (see  Figure  14).  The  probabilities  were  determined 
by  using  the  statistical  package  Mlnltab.  The  solution  Is 
limited  to  four  significant  figures.  The  probability  of  at 
least  S3  out  of  S9  pilots  choosing  this  format,  given  pilot 
Indifference,  is  0.0000. 

3.  Position  of  Degree  Nuaerale 

Question  3i  Paying  attention  only  to  the  position 
of  the  numbers  on  the  pitch  ladder  that  represent  degrees 
above  and  below  the  horizon,  rate  each  of  the  following 
numeral  positions  according  to  the  quality  of  Information 


44 


•nd  cu««  th«y  would  oiva  you  during  racovary  frorr  unuaual 
attltuda. 


/ 


This  quaatlon  aakad  tha  pllota  to  rata  18  diffarant 
numaral  poaltlona  on  tha  pitch  laddar.  Tha  aana  rating 
catagoriaa  wara  uaad  aa  In  quaatlon  ona. 

Tha  hlghaat-ratad  format  Inoludad  numarala  ahown  at 
both  outar  anda  of  both  tha  abova  tha  horizon  and  balow  tha 
horizon  pitch  laddar  (aaa  Flgura  14) .  Analyala  plaoad  thla 
aymbol  In  tha  Good  oatagory  (aaa  Flgura  16) *  A  total  of  45 
of  tha  pllota  placed  thla  aymbol  In  tha  Good  or  Bxcallant 
category.  All  other  aymbola  rated  only  Fair  or  Poor. 

Pilot  eommanta  on  thla  quaatlon  aupport  tha  concept 
of  laaa  clutter  In  tha  canter  of  tha  HUD.  Thaaa  Included. 
’’Don't  want  too  much  clutter  In  tha  middle  of  HUD"  and  "My 
ayaa  are  focuaad  to  tha  outar  anda  for  tha  "taila"  and  It 
la  aaaiar  to  aaa  tha  numbara  whan  they  are  located  thara". 

4.  Negative  Sign 

Quaatlon  4:  Paying  attention  to  tha  below-horizon 
numbara  on  tha  pitch  bare,  circle  tha  format  which  would 
give  you  the  moat  Information  during  recovery  from  unuaual 
attitudaa. 

Pllota  ware  aa)ced  to  chooae  whether  a  negative  sign 
ahould  be  dlaplayed  adjacent  to  the  balow-horlzon  number 
rapraaantlng  dagreaa.  Tha  option  without  tha  negative  sign 
waa  preferred  by  35  of  tha  reapondanta  (aaa  Flgura  14). 
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Fluurt  16.  Scaling  Reaults  for  tha  First  Survey 

Question  3 
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Th«  probability  of  at  least  35  out  of  60  pilots  choosing 
thiai  format,  given  Indifference,  is  0.0775. 

Pilot  comments  regarding  the  negative  sign  included 
"Too  much  clutter"  and  "The  dashed  line  of  the  below- 
horlzon  bar  is  enough  without  the  negative  sign".  One 
respondent  also  noted  that  "The  use  of  a  two  color  display 
would  be  helpful". 

5.  Velocity  Vector  Symbol  Cues 

Question  5:  At  high  angles  of  attack,  rate  the 
following  symbols  according  to  the  quality  of  information 
and  cues  they  would  give  you  during  recovery  from  unusual 
attitudes. 

The  fifth  question  asked  th?-:  pilots  to  rate  five 
different  velocity  vector  symbols,  with  and  without  an 
Xugie  Arrow.  The  same  rating  categories  were  used  as  in 
questions  one  and  three. 

The  standard  velocity  vector  or  flight  path  marker, 
with  and  without  an  Augie  Arrow,  rated  the  highest  of  the 
symbols  (see  Figure  14).  Analysis  placed  both  the  velocity 
vector  with  the  Augie  Arrow  and  the  velocity  vector  without 
the  Augie  Arrow  in  the  Good  categ^^ry  (see  Figure  17)  .  A 
total  of  11  pilots  placed  the  velocity  vector  with  the 
Augie  Arrow  in  the  Excellent  category,  while  22  rated  it  in 
the  Good  category.  Without  the  Augie  Arrow,  ten  placed  the 
symbol  in  the  Excellent  category  and  24  in  the  Good 
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eattgory.  Other  analyaia  results  can  be  found  In  Appendix 
C. 

Pilot  oomments  Indicated  concern  as  to  Khether  an 
arrow  would  be  Informative  or  directive.  Comments  Included, 
"Format  needs  to  be  directive;  both  arrows  and  words  should 
indicate  which  way  to  recover",  and  "In  low  altitude,  an 
arrow  should  show  where  the  ground  la". 

6.  CLIMB  As  a  Cue 

Question  6:  Circle  the  format  which  would  give  you 
the  moat  information  to  make  an  efficient  recovery,  when 
your  aircraft  is  at  an  unusual  attitude. 

For  this  gueation,  pilots  chose  their  favored 
format  when  given  two  options:  the  presence  of  the  word 
"CLIMB"  or  no  word  on  the  HUD,  Pilots  choosing  the  format 
with  the  word  "CLIMB"  present  totalled  34  (ass  Figure  14). 
The  probability  of  at  least  34  pilots  out  of  60  choosing 
this  format,  given  indifference,  is  0.1335. 

Pilot  comments  indicate  that  a  directive  word  would 
be  helpful.  They  also  noted  that  the  format  should  remain 
unchanged,  using  the  zenith  and  nadir  symbols  already 
present  on  the  current  HUD. 

7.  DXVB  As  A  Cue 

Question  7 :  Circle  the  format  which  would  give  you 
the  most  information  to  make  an  efficient  recovery,  when 
your  aircraft  is  at  an  unusual  attitude. 
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Th«  a«v«nth  quaatlon  askad  the  pilots  to  choose 
whether  the  word  *'DIVE''  should  bo  present  on  the  HUD,  when 
sppropriete.  A  total  of  37  of  the  pilots  preferred  using 
the  word  "DIVB''  (see  Figure  14) .  The  probability  of  at 
least  37  pilots  out  of  60  choosing  this  format,  given 
indifference,  is  0.0295. 

B.  SECOND  SURVEY  RESULTS 

Data  from  the  second  survey  were  analysed  according  to 
the  procedure  outlined  in  the  previous  chapter .  Summary 
results  are  given  in  Figure  18.  The  data  for  each  question 
are  available  in  Appendix  D.  The  results  for  each  question 
are  discussed  in  detail  below. 

1.  Augie  Arrow  Direction 

Question  It  If  an  arrow  is  present  on  the  HUD 
format,  as  displayed,  what  should  it  point  to7  Circle  one. 

The  first  question  had  the  pilots  choose  which 
direction  (ground,  horizon,  or  sky)  an  Augie  Arrow  should 
point  if  it  were  present  on  the  HUD.  Forty-three  out  of  56 
pilots  chose  the  inclusion  of  an  arrow.  The  "SKY”  option 
was  preferred  by  23  of  the  43  pilots  (so*  Figure  18).  The 
probability  of  at  least  23  pilots  out  of  43  choosing  this 
format,  given  Indifference,  is  0.0017. 

It  should  be  noted  that  13  of  the  pilots  Indicated 
that  they  do  not  want  any  arrow  and  chose  none  of  the 
formats.  Several  comments  on  the  surveys  support  the 
concept  that  an  arrow  may  not  be  a  good  idea:  "May  make 
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1.  Augl*  Arrow  pointod  2.  Ui«  of  Color 

towftrd  tho  tky. 


3.  Word  "CLIMB"  uiod  4.  Word  "DIVE"  uttd 


Flguro  18.  Formota  Fmvorod  on  tha  Sacond  Survay 
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5.  Vtlooity  Vtotor  with 
Auol«  Arrow. 


6.  "Sowtooth**  Pitch 
Ladder . 


7.  Enhanced  ADI  with  Standard  HUD. 


Figure  16.  Formata  Favored  on  the  Second  Survey  (Continued) 
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th«  velocity  vector  herder  to  Interpret  (eepeclelly 
Inverted)  ”  end  *'The  errow  mey  get  confused  with  TACAv 
nevigetlon" . 

Conunents  supporting  the  use  of  en  errow  Included, 
*'The  errow  needs  to  be  directive  tor  recovery'*,  end  "In  e 
spin  you  elweys  piece  the  stick  In  the  direction  of  the 
errow.  Following  the  seme  line  of  thinking,  In  the  unusuel 
ettltude  you  would  went  to  know  where  the  sky  Is  so  es  to 
pull  thet  direction". 

2.  Color  en  HUD 

Question  2t  1£  the  below-horlson  pitch  ledder  were 
shown  in  e  eontrestlng  color  to  ell  other  HUD  symbology, 
e.g.,  red,  would  thet  esslst  In  recovery  from  en  unusuel 
ettltude? 

K  totel  of  39  of  the  pilots  responded  efflrmetively 
to  this  question  (see  Figure  18).  The  probebillty  of  et 
leest  39  out  of  B6  pilots  choosing  this  formet,  given 
indifference,  is  0.0009 

The  comments  regerdlng  the  use  of  color  included. 
"Use  color  thet  doesn't  ruin  night  vision"..  The  feet  thet 
color  "would  esslst  in  unusuel  ettltude  recovery  but  mey 
clutter  up  the  HUD  with  more  unnecessery  Informetlon  for  e 
reguler  sltuetlon"  elso  wes  noted. 
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3.  InforMtioDttl  Cu«8  Whan  Noaa  la  Up 

Quaatlon  3i  At  oxtrama  anglea  of  attack,  If  xorda 
ara  uaad,  xhat  aorda  would  you  prafar  to  ba  ahown?  Clrcla 
ona. 

Pllota  wara  aakad  to  ehooaa  batwaan  tha  worda 
'*CLXMB"  and  "NOBI  UP*'  aa  Informatlva  cuaa  daacrlbing  tha 
poattlon  of  tha  aircraft.  Thlrty-alght  out  of  5S  pllota 
ohoaa  tha  praaanca  of  worda  on  tha  HUD.  Tha  word  "CLIMB" 
waa  prafarrad  by  SB  out  of  tha  38  (aaa  Figura  18) .  Tha 
probability  of  at  laaat  36  pllota  out  of  38  choosing  thla 
format,  glvan  Indlf faranca,  la  0.0069. 

A  total  of  18  of  tha  pilots  do  not  want  any  words, 
and  did  not  choosa  althar  word.  Savaral  of  tha  commants  on 
tha  aurvaya  support  not  adding  a  word  cua  on  tha  HUD: 
"Prafar  no  words",  "Not  a  good  Idas  avon  though  marked 
"CLIMB",  and  "Not  aura  words  would  halp". 

4.  Informational  Cuaa  Whan  Nosa  Is  Down 

Question  4:  At  axtrama  angles  of  attack,  if  words 
ara  used,  what  words  would  you  prafar  to  ba  shown?  Clrcla 
ona . 

Tha  fourth  question  aakad  tha  pilots  to  choosa 
between  tha  words  "MVS"  and  "NOSE  DOWN"  aa  Informative 
cues  describing  tha  position  of  tha  aircraft.  Thirty-savan 
out  of  B6  pilots  ehosa  tha  praaanca  of  words  on  tha  HUD. 
The  word  "DIVE"  was  prafarrad  by  33  out  of  the  37  pilots 
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Flour*  18).  Tht  probability  of  at  laaat  23  pilot*  out 
of  37  ehooaino  thia  format,  glvan  Indif faronca ,  la  0.0494. 

It  ahould  bo  notad  that  19  of  tha  pilot*  do  not 
want  any  word*  and  did  not  chooaa  althar  word,  cominant* 
Ineludad,  *'Not  a  good  Idaa,  word*  taka  too  much  attantlon 
damand",  ’*Prafar  no  word**',  and  **Unnao*aaary  eluttar  with 
word*". 

B.  Valooity  Vaotor  a*  a  Cua 

Quaatlon  Bt  Xt  axtrana  anglaa  of  attack,  graatar 
than  '«'60  dagraaa  or  laaa  than  -60  dagraaa,  what  format  do 
you  Ilka  baat?  Clrola  ona. 

Tha  option*  wara  (1)  having  tha  valooity  vaotor 
praaant,  along  with  an  Augl*  Arrow  and  tha  watarllna 
aymbol,  or,  (2)  dalatlng  tha  valooity  vaotor  and  di*playing 
only  tha  Augia  Arrow  on  tha  watarllna  aymbol.  A  total  of 
45  of  tha  raapondant*  prafarrad  ratalnlng  tha  valooity 
vaotor  (**a  Flgur*  18).  Tha  probability  of  at  laaat  45 
pilot*  out  of  56  ohooalng  thl*  format,  glvan  Indlf f aranca, 
1*  0.0000. 

Pilot  cominant*  axpraaaad  conoarn  with  HUD  eluttar 
if  many  aymbol*  ara  praaant.  Howavar,  a*  ona  commant 
indicatad,  "Tha  valooity  vaotor  with  an  arrow  i*  a  atrong 
viaual  oua". 

6.  Ixparlmantal  Pitch  Ladder 

Quaatlon  6t  It  ha*  baan  propoaad  that  tha  balow- 
horizon  pitch  ladder  b*  dlaplayad  a*  a  "aawtooth"  lino. 
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Should  this  dltpliiy  format  ba  furthar  taatad  to  datarmlna 
if  it  Kould  aaalat  in  raoovary  from  unuaual  attitudaa? 
Circ^a  ona. 

Approval  for  furthar  axpari mental  atudy  waa  oivan 
by  32  of  tha  raapendants  (aaa  Figura  18).  Tha  probability 
of  at  laaat  32  pilots  out  of  96  ehoosing  this  format,  givan 
indiffaranca,  Is  0.1144. 

7 .  ABI  Formats 

Quastion  7 1  Savaral  ADI  formats  hava  baan  proposad 
for  uaa  on  tha  F/A>18  DDl,  with  a  standard  HUD  format 
prasant.  of  tha  following  HUO/ADI  format  oombinatlons , 
clrcla  tha  ona  you  most  prafar. 

Pilots  wars  askad  to  ohoosa  tha  ona  thay  prafar 
from  fiva  dlffarant  HUD/ADi  oombinatlons.  Tha  ADI  format 
illustratad  in  flgura  18  was  strongly  prafarrad  (47  of  tha 
pilots) .  Tha  probability  of  at  laaat  47  pilots  out  of  96 
choosing  this  format,  givan  indiffaranca,  is  0.0000. 
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V.  C0MCUU8I0NS  AND  ^COMMENDATIONS 


A.  CONCLUSIONS 

V  Thtt  rtsults  of  survoyn  eorrioS  out  for  thl«  study  show 

pilot  support  for  ths  symbols  ourrsntly  ussd  on  ths  P/A-18 
HUD.  In  ordtr  to  provlds  sdditionsl  vlsusl  ouss  while  the 
slrorsft  is  in  sn  unusual  attitude «  pilots  show  moderate 
support  for  the  use  of  the  words  CLIMB  or  DXVX  (S7%-6a%) » 
sn  Augie  Arrow  (57%) ,  and  color  to  designate  below-horiton 
snglsB  (70%) . 

Previous  research  on  the  use  of  words  has  investigated 
the  use  of  ’'informative”  words  (such  as  NOSE  UP  or  NOSE 
DOWN)  to  cue  the  pilot  that  he  la  in  an  eKtreme  situation. 
A  large  proportion  prefer  that  qa  words  be  used  (33%-34%). 

••  If  such  cues  are  provided,  more  pilots  prefer  ths  use  of 

"directive"  words  such  as  CLIMB  or  DIVE  (41%-46%)  to  the 
previously  proposed  NOSE  UP/N08B  DOWN  terms  (aiE-aSA) . 

The  survey  showed  limited  support  for  addition  of  an 
Augie  Arrow  symbol  (57%) .  Preferred  direction  for  the 
arrow  to  point  is  towards  the  s)ty  (41%).  Pilot  comments 
Indicate  that  an  arrow  would  be  most  helpful  in  a  directive 
role.  The  arrow  should  be  allowed  to  be  part  of  the 
declutter  option,  however,  so  that  the  large  proportion  of 
pilots  who  will  not  use  it  can  remove  the  symbol  from  the 

‘  HUD. 
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Th«  tturvay  ahow^d  atrontf  support  for  tha  uaa  of  color 
on  tha  HUD  (70%) .  Concarn  ovar  posslbla  Intarfaranca  with 
night  vlaion  was  axpraaaad,  hoaavar.  Furthar  raaaarch  on 
uaa  of  apaclflc  unusual  attltuda  racovary  symbols  on  tha 
HUD  111  aupportad  by  a  majority  of  pilots  (87%).  Tha 
"sawtooth"  baloN-horlion  pitch  laddar  is  axpaotad  to 
provlda  iitrongsr  visual  cuss  to  indloata  that  tha  aircraft 
is  in  an  unusual  attitude. 

Tha  strongest  support  tor  a  craw  station  change  is  for 
a  now  format  for  tha  ADI  whan  displayed  on  a  DDI.  A  total 
of  84%  of  raspondauta  prafar  an  ADI  (used  in  combination 
with  standard  r/A-18  HUD  formats)  that  gives  a  strong 
visual  indication  of  above-  and  bslow-horixon  angles.  Tha 
ability  to  obsarva  such  an  ADI  format  during  normal 
instrumant  scan  is  daamad  vary  Important. 

Tha  use  of  a  survey  of  military  pilots  has  bean 
informative  for  isolating  areas  for  furthar  research.  It 
la  apparent  that  tha  pilots  surveyed  are  satisfied  with  tha 
currant  F/A-18  HUD  formats  and  symbols.  It  has  bean 
observed  that  tha  loss  of  aircraft  due  to  loss  of 
situational  awareness  may  be  due  to  training  problems. 
Training  command  aircraft  do  not  use  tha  same  HUD  formats 
as  do  tactical  aircraft.  Thus  pilots  may  not  racaiva 
enough  axparianca  in  HUD  uaa  prior  to  assignment  to  an  F/A- 
18  squadron. 
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B .  RBCOMMINDATZONS 

It  is  rtOQnunvndtd  th«t  th*  aymboli  and  format! 
-  ourrantly  uaad  on  tha  F/X-IS  HUD  ba  ratainad.  In  addition, 

an  Augla  Arrow  ahould  ba  an  option  for  tha  pilots  to  usa  if 
thara  is  a  possibility  of  baing  in  an  unusual  attltuda. 
Bines  oelor  is  a  good  visual  oua  (aapaoially  whan  tha  HUD 
symbols  ara  moving  rapidly) ,  a  color  oua  should  ba 
oonsldarad  as  a  balow-horison  Indicator  on  tha  HUD  and  tha 
ADI. 

Tha  pilots  showad  tha  atrongast  support  for  a  ohanga  in 
tha  ADI  format.  Tha  pilots  oommants  and  rasponsas  indioata 
that  tha  HUD  is  satisfactory  but  tha  ADX  display  is  a  moro 
useful  visual  oua  in  unusual  attitudes.  Tha  enhanced  ADI, 
•  as  proposed,  ahould  ba  Incorporated  in  tha  craw  station  as 

soon  as  poaalbla. 

Further  axparlmantal  research  ihould  ba  carried  out  in 
the  following  areas i 

1.  Tha  usa  of  dlractlva  versus  informative  words  whan 
tha  pilot  is  in  extrema  situations. 

a.  Tha  use  of  a  sky  pointer  Augie  Arrow. 

3.  Tha  usa  of  color  on  the  HUD  and  ADI. 

4.  New  formats  for  tha  ADI  whan  displayed  on  tha  DDI. 

5.  Visually  distinct  pitch  ladders. 

All  new  formats  should  ba  tasted  dynamically  in  a 

a 

ground-based  slmullator  similar  to  tha  Craw  Evaluation 
»  Facility  at  NADC.  Tha  dependant  variables  should  include 
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pilot  renctlon  time  and  time  to  recover  from  an  unusual 
attitude  for  each  of  the  Independent  variables. 


« 
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APPENDIX  A.  FIRST  SURVEY  FORM 


INTRODUCTION 

Background:  Several  F/A^lSa  have  been  lost  in  mishaps 
where  loss  of  situational  awareness,  spatial 
disorientation,  or  unexplained  flight  into  the  surface  are 
listed  as  confirmed  or  probable  cause  factors.  Evidence 
points  to  inadequate  or  ambiguous  attitude  displays 
available  to  the  pilot.  A  potential  problem  may  be  an 
inability  of  the  pilot  to  recognize  when  ha  is  in  an 
unusual  attitude  and  than  recover  using  the  HUD. 

Objective  of  this  study:  The  purpose  of  this 
quastlonaire  is  to  determine  what  types  of  variables 
present  on  the  HUD  can  best  assist  the  pilot  1)  to 
determine  his  current  position  during  an  unusual  attitude 
and  2)  to  make  an  efficient  recovery. 

Please  respond  to  the  questions  taking  into  account 
your  exporienee  while  flying  aircraft  and  using  HUDs.  I  am 
interested  in  your  recommendations  for  the  HUD  variables 
that  would  beat  assist  you  in  unusual  attitude  situations. 
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F/A  18  AlrcrttH  Survey  on  HUD  Variables 
During  Unusual  Attitudes 
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HUD  FORMAT  CUES  DURING  UNUSUAL  ATTITUDE 


PITCH  LADDER  "TAIL"  FORMATS 

1.  Paying  attention  only  to  the  HUD  pitch  ladder  "tail" 
formate,  rate  each  of  the  following  tail  poaitione 
according  to  the  quality  of  information  and  cues  they  would 
give  you  during  recovery  from  unusual  attitude. 
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PITCH  LADDER  BAR  ANGLES 


2.  Paying  attention  only  to  the  angle  of  the  pitch  bars, 
circle  the  format  that  would  give  you  the  better  quality  of 
Information  during  recovery  from  unuaual  attitude. 


Conitant  Angle 
Continuous  Sloping 


Bars  are  Level  at  Horizon, 
with  Angle  Increasing  with 
Increased  Distance  from 
Horizon 


64 


POSITION  OF  DEGREE  NUMERALS 


3.  Paying  ittantion  only  to  the  position  of  the  numbors  on 
the  pitch  ladder  that  represent  degrees  above  and  below  the 
horlzonr  rate  each  of  the  following  numeral  positions 
according  to  the  quality  of  information  and  cues  they  would 
give  you  during  recovery  from  unusual  attitude. 


Quality  et  Xnteraatien  ourley  aaeovary  From  unuaual  attitude 
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Foor 

Quality 

Fair 

Quality 

Oeod 

Quality 

■xeallai 

Quality 

Ai, 

i  1 

(  I 

(  1 

(  t 

(  ) 

(  1 

B. 

••  -T  -  la^ 

(  ) 

(  ) 

(  ) 

(  > 

(  ) 

C. 

(  ) 

(  ) 

(  > 

(  ) 

(  ) 

0. 

(  ) 

eat  M  M 

(  ) 

(  ) 

(  ) 

(  ) 

E. 

1 

(  ) 

<  ) 

(  > 

(  ) 
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Quality  oC  Zntornatlen  During  lltcorary  yrom  Unuaual  Attituda 


Tarriblfi  foor  mlr  Good 

Quality  Quality  Quality  Quality 


(  ) 


(  I 


(  ) 


"**(  )  (  »  M  (  > 

r 


H. 

*  !’(  )  (  »  (  )  (  > 


I. 

"i  <  )  <  »  (  )  {  ) 


(  ) 


(  ) 


(  ) 


(  ) 


(  ) 


(  ) 


L. 

^  *  (  »  (  »  (  )  (  ) 
r  T 


Ixeallant 

Quality 


(  ) 


(  ) 


{  ) 


(  ) 


(  ) 


(  ) 


(  ) 


66 


QuDllty  of  Inforaitlon  During  Xteovtry  Fron  UnuiutI  Attltudt 


Tcrrlblu 

Quality 

Foor 

Quality 

Fair 

Quality 

Ooed 

Quality 

Ixeallant 

Quality 

M. 

i  - 

«■  M  Mt 

t  ) 

M  «M  ai»  w  t 

(  ) 

{  )  " 

(  ) 

(  ) 

N. 

• 

t 

W  M  1 

1  ) 

(  ) 

<  ) 

(  ) 

(  ) 

0. 

M  M  1 

(  1 

(  ) 

(  ) 

(  ) 

(  ) 

p. 

— 

■  "'■'—T 

(  i 

<  ) 

(  ) 

(  ) 

(  > 

Q. 

’  ' 

( ) 

(  ) 

(  ) 

(  ) 

(  ) 

jr 

R. 

S 

_ » 

(  ) 

(  ) 

(  ) 

(  ) 

(  \ 
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NEGATIVE  SIGN 


4.  Paying  attantion  to  the  below-horlzon  numbers  on  the 
pitch  bars,  circle  the  format  which  would  give  you  the  most 
information  during  recovery  from  unusual  attitudes. 
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VELOCITY  VECTOR  SYMBOL  CUES 


5.  At  high  angltts  of  attack,  rata  tha  folloalng  symbols 
according  to  tha  quality  of  Information  and  cuas  thay  would 
glva  you  during  racovary  from  unusual  attitudas. 


Quality  ef  XntotHatioii  Ourino  Raaovary  rrea  Unusual  Rttituda 


Tarribla  toor  fair  Oaad  iKoailant 

Quality  Quality  Quality  Quality  Quality 


(  )  (  )  (  )  M 


(  ) 
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WORDS  AS  CUBS 


6.  Circl«  th«  format  which  would  give  you  the  moat 
information  to  make  an  efficient  recovery,  when  your  aircraft 
ia  at  an  unuaual  attitude. 


Wi 

lie 

••  1 

iM 

C  i  1 

1  n  ■ 

■f  1 

i*» 

•>  1 — 

t 

***"******1 

7.  Circle  the  format  which  would  give  you  the  moat 
information  to  make  an  efficient  recovery,  when  your  aircraft 
ie  at  an  unuaual  attitude. 
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APPENDIX  B.  SECOND  SURVEY  FORM 


Introduotlon  and  Xnatruotiona 

Background t  Savtral  f/k  18a  hava  baan  lost  In  mlahapa 
Nhara  loaa  of  altuatlonal  awaranaaa,  apatlal  dlaoriantatlon, 
or  unaxplalnad  flight  Into  tha  aurfaoa  art  llatad  aa 
eonflrmad  or  probabla  causa.  Evldanoa  points  to  inadaquata  or 
ambiguous  attituda  displays  availabla  to  tha  pilot.  A 
potantial  problam  may  ba  an  inability  of  tha  pilot  to 
racogniia  whan  ha  is  in  an  unusual  attituda  and  than  racovar 
uaing  tha  HUD. 

Objactiva  of  thia  study:  X  am  attampting  to  isolata  HUD 
and  othar  display  variables  that  pilots  prafar  or  racommand 
for  uaa  in  racovary  from  unusual  aircraft  attitudes.  I  am 
most  intarastad  in  determining  what  cues  can  bast  help  tha 
pilot,  in  order  to  prevent  further  mishaps.  Results  of  this 
quastionaira  will  ba  used  for  further  axparimantal  study  in  a 
realistic  environment. 

Thia  is  tha  second  of  two  quastionairas  eliciting 
opinions  on  tha  bast  way  to  display  information  related  to 
unusual  aircraft  attitudes.  In  tha  first  (which  you  may  have 
filled  out),  opinions  ware  obtained  on  tha  preferred  knids  of 
symbols  for  HUD  displays.  This  second  quastionaira  takas  into 
account  tha  results  of  that  first  survey;  the  most^prafarrad 
symbols  now  hava  baan  incorporated  into  overall  HUD  display 
formats.  Possible  formats  for  an  ADI  also  are  included  hare. 

Please  respond  to  tha  questions,  taking  into  account  your 
axparianca  while  flying  aircraft  and  using  tha  HUD  and  tho 
ADI.  1  am  intarastad  in  your  racomandations  for  the  HUD 
variablaa,  alone  and  in  combination  with  tha  ADI,  that  would 
bast  assist  you  in  unusual  attituda  situations. 
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F/K  18  Aircrew  Survey  on  HUD  Variables 
During  Unuaual  Attitudes 


Total  Hours  { 

) 

<  500 

( 

) 

500  - 

1000 

( 

) 

1000  -  2000 

( 

) 

>  2000 

Tao  Jet  Hours  ( 

) 

<  500 

{ 

) 

600  - 

1000 

1 

) 

1000  -  2000 

( 

) 

>  2000 

F/A  16  Hours  ( 

) 

<  500 

( 

) 

500  - 

1000 

{ 

) 

1000  >  2000 

1 

) 

>  2000 

Combat  Hxperlenae 

(  )  YES 

( 

) 

NO 

Service 

(  )  USN 

( 

) 

USMC 
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AUOIB  ARROW  DIRECTION 


1.  If  an  arrow  la  praaant  on  tha  HUD  format  aa  displayed, 
what  should  It  point  to?  Clrcla  one. 


OROUND  HORIZON 


SKY 


Comments i 
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COLOR  ON  HUD 


2.  If  the  below-horizon  pitch  ladder  were  shown  in  a 

cjon' lasting  color  to  all  other  HUD  symbology  e.g.  red, 
would  that  assist  in  recovery  from  an  unusual  attitude? 
Circle  one. 


YES 


NO 


Commente: 
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WORDING  OF  INFORMATIONAL  CUES 


3.  At  extreme  angles  of  attack r  If  words  are  used,  what 
words  would  you  prefer  to  be  shown?  Circle  one. 


Comments : 
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WORDING  OP  INFORMATIONAL  CUES 

4.  At  extramft  atiglaB  of  attack.  If  words  are  used,  what 
words  would  you  prefer  to  be  shown?  Circle  one. 


« 


Comments : 
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VELOCITY  VECTOR  AS  A  CUE 


5.  At  ®xtreme  angles  of  attack,  greater  than  +60  degrees 
or  leas  than  -60  degrees,  what  format  do  you  like  best? 
Circle  one. 


velocity  vector  present  delete  velocity  vector 


Comments : 
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EXPERIMENTAL  PITCH  LADDER 


6.  It  hai  bean  proposed  that  the  below-horlzon  pitch 

ladder  be  displayed  as  a  "sawtooth"  line.  Should  this 
display  format  be  further  tested  to  determine  If  It 
would  assist  in  recovery  from  unusual  attitudes? 
Circle  one. 


YES 


NO 


( 


Comments i 
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ADI  FORMATS 


7.  Sev«r«l  ADI  formats  have  been  proposed  for  use  on  the 
DDI,  with  a  standard  HUD  format  present.  Of  the 
following  HUD/ADI  format  combinations,  circle  the  one 
you  moat  prefer.  Continues  on  following  page. 


_ _ _  *•“  >10  . 

CSD  .  nnn  i 


I 
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APPENDIX  C.  FIRST  SURVEY  RESULTS 
MUD  FORMAT  CUES  DURING  UNUSUAL  ATTITUDE 
PITCH  LADDER  "TAIL"  FORMATS 

1.  Paying  attantlon  only  to  tha  HUD  pitch  ladder  "tall" 
formate »  rata  each  of  the  following  tall  poaltlona  according 
to  the  quality  of  Information  and  cues  they  would  give  you 
during  recovery  from  unusual  attitude. 


Quality  of 

Xnforeation  Burlaa  Meovary  rren  Unuaual  Kttituda 

Ttrrlbla 

Poor 

ralr 

Ooed 

laeallaat 

Quality 

Quality 

Quality 

Quality 

Quality 

Ruabar  I 

18 

11 

> 

A 

. >L... 

14% 

41% 

11% 

18% 

7% 

leila 

ulua  o.na 

Muabar  1 

4 

it 

iO 

L 

-J 

14% 

41% 

18% 

10% 

0% 

leila 

talua  0.181 

Muabtr  4 

11 

8 

18 

» 

r- 

L 

. _ 

-  J 

7% 

10% 

15% 

41% 

18% 

leilt 

valdt  i.ai 

Muabar  4 

11 

11 

14 

1 

r" 

1 

1 

i 

1 

_i 

1 

1 

1 

1 

1 

_ 

7% 

16% 

11% 

14% 

8% 

leilt 

Ulua  1.01 

Muabar  11 

IT 

1) 

7 

1 

14% 

11% 

11% 

11% 

1% 

Iet\t  -O.aiJ 
Vtlut 
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PITCH  LADDER  BAR  ANGLES 


2.  Paying  attention  only  to  the  angle  of  the  pitch  bars, 
circle  the  format  that  would  give  you  the  better  quality  of 
information  during  recovery  from  unusual  attitude. 


Constant  Angle 
Continuous  Sloping 


Bars  are  Level  at  Horizon, 
with  Angle  Increasing  with 
increased  Distance  from 
Horizon 


Number  6 


k 

53 


11% 


89% 


4 
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POSITION  OF  DEGREE  NUMERALS 


3.  Paying  attention  only  to  the  position  of  the  numbers  on 
the  pitch  ladder  that  represent  degrees  above  and  below  the 
horizon,  rate  each  of  the  following  numeral  positions 
according  to  the  quality  of  Information  and  cues  they  would 
give  you  during  recovery  from  unusual  attitude. 


Quality  of  XnCeraation  Ourins  Raeevary  rron  Unuaual  Attltuda 


TarrltiU 

Poor 

rair 

0ml 

laetllant 

Quality 

Quality 

Quality 

Quality 

Quality 

,  Huabtr  10 

11 

11 

11 

a 

•  a  lit 

JOt 

»t 

ait 

St 

lealt 

1 

Valua  -.oil 

* 

Ruabar  1 

IT 

14 

1 

0 

It 

lit 

lot 

It 

ot 

lOllfl 

Valut  •O.lt 


,,  . . .  Ruabar  1 

aa 

ai 

a 

0 

lot 

lit 

lot 

St 

ot 

l«aU 

Valua  •‘0.44 

, Ruabar  0 

4 

11 

SI 

14 

t  _  i....  -  _  _  . 

Ot 

It 

lit 

lat 

ast 

leala 

Valua  1.014 

•  Ruabar  V 

JS 

11 

a 

0 

,  lit 

lit 

ait 

ot 

leiU 

VllU*  -O.fO 
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I 


r 


I 


r" 

r 


Qukllty  of  inferaation  During  llaeovarf  rron  Unusual 


r 

r 


r 


I 


I 


(  I 


T  r 
r  T 


Tarrlblt 

Oualltr 

Poor 

Quality 

Pair 

Quality 

Ooo4 

Quality 

Nuabar  1 

22 

12 

2 

100 

120 

220 

20 

loll* 

Hlua  •O.IO 

luabar  T 

24 

11 

1 

110 

170 

200 

10 

laala 

Talua  -O.ll 

luabar  14 

21 

12 

1 

2)0 

120 

210 

20 

loala 

lalua  -0.712 

luabar  14 

22 

11 

1 

220 

120 

110 

20 

Ictla 

falua  -O.TOI 

luabar  11 

12 

21 

1 

110 

ISO 

400 

120 

loala 

Oalua  -0.174 

luabar  1 

21 

11 

1 

40 

400 

200 

20 

loala 

Talua  -0.121 

luabar  1 

21 

14 

12 

120 

220 

120 

320 

fell* 

Hlua  •0.121 


Xttltuda 

Ixoallant 

Quilltr 

0 

0% 

0 

0% 

0 

00 

1 

10 

2 

20 

0 

00 

4 

eo 
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Quality  eC  XnCorMatlon  Dutlno  Raeovary  rrem  Unuaual  Attituda 


Tarrlbla 

ftaailtf 

Voor 

Quality 

nir 

Quality 

Onod 

Quality 

Ixcaltant 

Quality 

Nuabat  1 

II 

14 

7 

1 

*  * 

lit 

sot 

4St 

lit 

3t 

m  m»  m  m  mm  m 

•oalt 

vaiaa  -o.tli 

. 

Raabar  13 

31 

10 

1 

0 

• 

* 

lit 

Sit 

17t 

It 

ot 

mm  tmt  m 

leala 

talua  -O.Tn 

Nuabar  f 

11 

11 

11 

1 

t  1 

1st 

44t 

lit 

lot 

St 

leala 

Value  >0.403 

Nuabar  13 

31 

11 

> 

0 

—  -  - 

-  -  - 

lit 

leala 

Value  -0.713 

Sit 

lot 

It 

ot 

Nuabar  1 

13 

10 

1 

1 

.  1 

lot 

3St 

))t 

lit 

It 

r* 

leala 

Valua  -0.11 

i 

,  Nuabar  7 

11 

11 

11 

1 

1  t 

■  M  aa  «  IN  aa  ■ 

lit 

■  aa»  ai  aU  aa 

sot 

sst 

lot 

St 

letlf 

viiu*  -0,01 


IS 


NBOATIV£  SIGN 


4.  Paylncr  attantion  to  the  below-horlzon  numbers  on  the 
pitch  bars,  circle  the  format  which  would  give  you  the  most 
information  during  recovery  from  unusual  attitudes. 


j -  .  . — » 


Number  25 


35 


42% 


B8% 


4 


% 
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VELOCITY  VECTOR  SYHBOL  CUES 

5.  At  high  unglti  of  attack,  rate  the  following  symbols 
according  to  the  quality  of  Information  and  cues  they  would 
give  you  during  roaovary  from  unusual  attitudes. 


guAliity  af  infaraatlan  ourlne  atoevarf  rroa  uniiauai  attituae 


Tttrlkli 

Fm* 

thutiir 

Nir 

ewitiiy 

loel 

Oiitily 

imltiMl 

giiiiiy 

Naalitr  4 

14 

1 

II 

It 

n 

HI 

HI 

HI 

uh 

leiU 

VtiM  4.11 

• 

■ 

a««b«k  II 

a 

1 

0 

• 

411 

III 

11 

41 

01 

leiU 

-t.ll 

HMk«k  It 

It 

1 

• 

4 

111 

III 

HI 

III 

tl 

lent 

ftlv*  •4.14 

•ubtt  t1 

14 

V 

1 

4 

III 

411 

HI 

141 

41 

Iditli* 

7ll«f  •1.41 

4 

19 

II 

14 

t 

141 

HI 

III 

HI 

II 

l«Kl4 

««4«i  'l.tl 

Hiaktt  I 

t 

H 

14 

14 

•1 

til 

IH 

411 

HI 

Irilf 
fll««  V.lf 


17 


WORDS  AS  CUES 


6 .  Circle  the  format  which  would  give  you  the  most 
information  to  make  an  efficient  recovery,  when  your  aircraft 
is  at  an  unusual  attitude. 


Ml  -  !«•  I  _ 

C  I  I  M  s 

„  I - - -  - ^ - Its  I -  - ISS 


Number 

26 

34 

43% 

57% 

7.  Circle  the  format  which  would  give  you  the  most 
information  to  make  an  efficient  recovery,  when  your  aircraft 
is  at  an  unusual  attitude. 
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APPENDIX  0.  SECOND  SURVEY  RESULTS 
AUGIE  ARROW  DIRECTION 

1.  If  an  arrow  la  praaent  on  the  HUD  format  aa  dlaplayed, 
what  ahould  It  point  to?  Clrcla  one. 


ran 


■  t.( 


CSQ 


It . jt 


Number 


GROUND 

2 

4% 


HORIZON 
Number  18 
J2% 


Number  23 

41% 


No  Arrow 
Number  13 
23% 
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COLOR  ON  HUD 


3.  If  the  beloH-horlzon  pitch  ladder  were  shown  In  a 

contrasting  color  to  all  other  HUD  symbology  e.g.  red, 
would  that  assist  in  recovery  from  an  unusual  attitude? 
Circle  one. 


4 


YES  NO 


Number 

39 

17 

70% 

30% 

t 
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WORDING  OF  INFORMATIONAL  CUES 

3.  At  extreme  angles  of  attack,  if  words  are  used,  what 
words  would  you  prefer  to  be  shown?  Circle  one. 


Number  26 

46% 


No  Words 
Number  18 
33% 
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WOilDING  OF  INFORMATIONAL  CUES 

4.  At  extreme  anuloa  of  attack,  if  words  are  used,  what 
words  would  you  prefer  to  be  shown?  Circle  one. 


^  .  T  .  J  X  ^ 

J  "  .  T  ,  5;  *  ^ 

USB  ^  ^  u.yQli3 

!V  t 

-  -s 

/  *•  ■ 

5iB  .  ‘  ^  tnig 

"L-'-iS 

/  >  X 

Ll_i^LV'  '  j 

','i'  '  J 

Number  23 

14 

41% 

25% 

No  Words 

Number  19 

34% 


f 
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VELOCITY  VECTOR  AS  A  CUE 


5.  At  extreme  angles  of  attack,  greater  than  -<*60  degreoa 
or  leaa  than  -60  degrees,  what  format  do  you  like  best? 
Circle  one. 


'■■A 

BIB  SIIHI 


•  «  I 


-“"?a 


\ ' 


/  ^  V 

/  .  1 


—  i4W 


velocity  vector  present  delete  velocity  vector 


Number  45 


11 


80% 


20% 
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I'XPBRXMEHTAL  PITCH  LADDER 


6.  It  had  been  proposed  that  the  below-horlzon  pitch 

ladder  be  displayed  as  a  "sawtooth"  line.  Should  this 
display  format  be  further  tested  to  determine  If  It 
would  assist  In  recovery  from  unusual  attitudes? 
Circle  one. 


Number 


L:.. 

A 

YES 

NO 

32 

24 

57% 

43% 

r 
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ADI  FORMATS 


7.  Several  ADI  formate  have  been  proposed  for  use  on  the 
DDI,  with  a  standard  HUD  format  present.  Of  the 
following  HUD/ADI  format  combinations,  circle  the  one 
you  most  prefer.  Continues  on  following  page. 


95 


LIST  OF  REFERENCES 


1.  McDonnell  Aircraft  Company,  E/A  18  Hornet  Crew  Station, 
by  B.  C.  Adama,  August  1981. 

2.  Naval  Air  Development  Center,  Off  j"-— 

Hf»ti-»p~Dtap^av  for  Recovery  from  Vnuaml  AttitrOdfff* 
Aircraft  upd  pvfcema  Technology  Diyeetg.r.Atft>  by  J- 

Outtmiin#  1986. 

3.  Royal  Air  Force  Institute  of  Aviation  Medicine,  |fi.m,9 

Tflltnlf  Dienlav  Formed  bP 

“»  iTvZvI?*-  finatlai  Orientation,  by  R.  M.  laylor,  1984. 


rom  Unuaual  Attj 


^A"18 


I,  by  J. 


4.  Letioore  Naval  Air  Station, 

...  _  .<  _• 


Enhlneeg 
Kennedy,  1988 . 


(Draft) ,  by  LCDR  D. 


6.'  ,  Air  Force  Wright  Aeronautical  Laboratoriee, 

'  Dteplav  Dalian  ouide .  Improyeii^eD^  of  -ttiJld-tJp  pjfPUy 
standerda  Vol .  1,  by  R.  L.  Newman,  1987. 


6.  McDonnell  Douglas  Corporation  Report  N60530-83-0-0227 , 

&mAUsA9t  f /A-jj 

with  8SA  Operational  Preoramt,  July  1986. 

I.  Air  Force  Wright  Aeronautical  Laboratories ,  Ryil^|iQD 
il^jf  ftaad-up  Dicplays  to  Enhance  VnugtfOl 
Recovery.  Improvement  of  Heed-UP,  Pjapluy  PtanteA»-jy.alA. 
Ji,  by  R.  L.  Newman,  1987. 

8.  Naval  Air  Development  Center,  i^...Cojiy?iriBaiL_of.J.WJL-Eitc^^^ 
jf^ddar  Formats  and  an  Apj _ Bl  U — £ojr — RSiS^ilXy~Il  2IJ 

Directorate,  by  S.  A.  Kinsley,  N.  W.  Warner,  and  D. 
Oleianer,  1985. 

S.  Instrument  Flight  Center,  Randolph  AFB,  gol5^1,^fia|z.UE 
Display  ij)  Instrument  Fl^gM>  by  J.  F.  Barnett,  1976. 

10  Air  Force  Aerospace  Medical  Research  Laboratory , 
-  -  •  -  —  • - M4I.U  Maad-Up  Displayi 


serat.ioi 


1,  by  R.  L.  Newman,  1980. 


11.  Naval  Air  Test  Center,  Bvelufttipn. ..Oi-— a  SSgKAoAd 

Control 

Linton,  and  R, J.Splcusaa,  1982. 


97 


12.  Ntval  Air  Teat  Center ,  F/A-18  Situational  Awareness 

Queetionalre.  Strike.  Aircraft  Teat  Directorate,  by  B. 
Jevitt  and  S.  Merrlnan,  1984. 

13.  U.S.  Army  Reaeareh  Institute  for  the  Behavioral 

Sciences,  Questlonalre  Construction  Manual,  by  D.  R.  F. 
Dyer,  J.  J.  Matthews,  C.  E.  Wright,  and  K.  L. 

Yudowitch,  1976. 

14.  Torgeraon,  W.  S.,  Theory  and  Methods  of  Sealing,  Wiley, 
1958. 

15.  DeOroot,  M.H.,  Probability and  Statlatlcs  (Second 
Edition) .  Addlaon-Wealey,  1986. 


i 


V 


a 


r 


98 


t 


INITIAL  DISTRIBUTION  LIST 


1 


) 


4 


1.  Dafcnsa  Taehnical  Information  Cantor  ? 

Camaron  Station 

Alaxandrla,  Virginia  a2304-'€14S 

2.  Library,  Coda  0142  2 

Naval  Poatgraduata  School 

Montaray,  California  93ili43-&002 

3.  Profaaaor  Judith  H.  Lind  (Coda  55L1)  1 

Dapartmant  of  Oparatlona  Raaaarch 
Naval  Poatgraduata  School 
Montaray,  California  93943-5000 

4.  Profaaaor  Jamaa  Baary  (Coda  55By) 

Dapartmant  of  Oparatlona  Raaaarch 
Naval  Poatgraduata  School 
Montaray,  California  93943-5000 

5.  LCDR  Tom  Mitchell  (Coda  S5M1) 

Dapartmant  of  Oparatlona  Raaaarch 
Naval  Poatgraduata  School 
Montaray,  California  93943-5000 

6.  Curricular  Officer,  Coda  30 
Oparatlona  Analyala 
Naval  Poatgraduata  School 
Montaray,  California  93943-5000 

7.  Commander  (Coda  71)  1 

Attn:  Jeffrey  Groasman 

Navy  Paraonnal  Raaaarch  and  Development  Canter 
San  Dlago,  California  92152-6800 

8.  LCDR  Dave  Kennedy  1 

Safety  Officer 

VFA  1113 

NAS  Lamoora,  California  93246 

9.  LCDR  Bob  Wooda  1 

Training  Officer 

VFA  125 

NAS  Lamoora,  California  93246 


1 


1 


1 


99 


2 


10.  Michael  Barnes 
Naval  Air  Development  Canter 
Code  6021 

Warminster,  Pennsylvania  18974 

11.  Jonathan  Kern  1 

Veda  Incorporated 

600  Louis  Drive  { 

Suite  100 

Warminster,  Pennsylvania  18974 

12.  Kim  Frankenberger ,  Code  3152  1 

Naval  Weapons  Center 

China  Lake,  California 

13.  Patrick  Croyle  1 

Naval  Weapons  Center 

China  Lake,  California  93555 

14.  Howard  Arnoff  1 

Air  5313 

Naval  Air  Systems  Command 
Washington,  DC  20361 

15.  LT  Leah  Roust  1 

Military  Sealift  Command 

Naha,  Okinawa  ( 

FPO  Seattle,  Washington  98773-2600 


r 


k 


r 


100 


